Andrew Goss andrewrgoss
andrewrgoss
/ scraper-api-basic-demo.py
Created
November 13, 2020 20:31
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # !/usr/bin/env python | |
| __author__ = 'agoss' | |
| import argparse | |
| import json | |
| import requests | |
| from scraper_api import ScraperAPIClient | |
| import sys | |
andrewrgoss
/ dataproc-cluster-m.txt
Created
July 18, 2018 19:18
GCP Leveraging Unstructured Data - Lab 3: Submit Dataproc jobs for unstructured data
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Connected, host fingerprint: ssh-rsa 2048 F3:7F:24:6D:E9:7B:B1:16:6C:D8:49:A7:CF:C0:7A:23:25 | |
| :EB:72:AF | |
| The programs included with the Debian GNU/Linux system are free software; | |
| the exact distribution terms for each program are described in the | |
| individual files in /usr/share/doc/*/copyright. | |
| Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent | |
| permitted by applicable law. | |
| google710312_student@dataproc-cluster-m:~$ cd |
andrewrgoss
/ TweetLength.jar
Created
March 27, 2018 17:40
Twitter_streaming console output from TweetLength.scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ------------------------------------------- | |
| Time: 1522165838000 ms | |
| ------------------------------------------- | |
| (140,94) | |
| (139,16) | |
| (138,4) | |
| (120,3) | |
| (109,3) | |
| (131,3) | |
| (84,2) |
andrewrgoss
/ publish.go
Last active
August 29, 2018 10:48
Getting started with NSQ for Go - creating a producer
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| import ( | |
| "log" | |
| "github.com/nsqio/go-nsq" | |
| ) | |
| func main() { | |
| config := nsq.NewConfig() |
andrewrgoss
/ consume.go
Last active
August 29, 2018 10:48
Getting started with NSQ for Go - creating a consumer
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| import ( | |
| "log" | |
| "sync" | |
| "github.com/nsqio/go-nsq" | |
| ) | |
| func main() { |
andrewrgoss
/ MovieSimilarities1M.jar
Last active
March 23, 2018 19:44
Console output from MovieSimilarities1M.scala - creating similar movie recommendations from one million ratings, run on AWS EMR cluster
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| mymachine:~ andgoss$ ssh -i ~/.credentials/ag-spark.pem [email protected] | |
| Last login: Thu Mar 8 16:53:31 2018 | |
| __| __|_ ) | |
| _| ( / Amazon Linux AMI | |
| ___|\___|___| | |
| https://aws.amazon.com/amazon-linux-ami/2017.09-release-notes/ | |
| 3 package(s) needed for security, out of 5 available | |
| Run "sudo yum update" to apply all updates. |
andrewrgoss
/ DataChatter.jar
Last active
March 23, 2018 19:28
Twitter_streaming console output from DataChatter.scala
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ------------------------------------------- | |
| Time: 1521748832000 ms | |
| ------------------------------------------- | |
| (facebook,62) | |
| (cambridge,22) | |
| (zuckerberg,20) | |
| (analytica,18) | |
| (weather,17) | |
| (mark,15) | |
| (people,15) |
andrewrgoss
/ PopularHashtags.jar
Last active
June 21, 2018 03:07
Twitter_streaming console output from PopularHashtags.scala