fhoffa

14 ms·

91.
by fhoffa 10y ago
If you want to verify some of these claims, the data is already loaded in BigQuery and ready to be analyzed: - https://cloud.google.com/bigquery/public-data/bay-bike-share Btw, I was surprised to see ridership go
92.
by fhoffa 10y ago
I'm wondering if you are going to reply to the comment that Heath Maddox, SFMTA, left. My only agenda here is that I want more bikes around SF, so I like your proposal - but I would also like to know what's the truth behind both p
93.
by fhoffa 10y ago
Data points: So this post made it to the front page with few votes, but 2 hours later it dropped off with 31 votes. Lessons: - Maybe don't post on a Friday afternoon. - Maybe don't post from medium.com (low chances). - >40 scor
94.
by fhoffa 10y ago
We need to test this - but I'm almost sure we have the latest version of each comment in BigQuery.
95.
by fhoffa 10y ago
You are the expert! (and I linked to one of your posts in the article too) Replying to the comments: 1) Yes, it doesn't take many votes to reach the front page, but once a post gets established there I expect it to gather more upvotes
96.
by fhoffa 10y ago
I'm not sure if we are ready to document the process, but I can tell you that having an API based on Firebase helps a lot: - https://github.com/HackerNews/API
97.
Hacker News on BigQuery: Now with daily updates. Top domains and time to post?(medium.com)
52 points by fhoffa 10y ago|9 comments
98.
by fhoffa 10y ago
data wants to be shared - thanks for the inspiration!
99.
The news sources that Reddit prefers(medium.com)
3 points by fhoffa 10y ago|2 comments
100.
by fhoffa 10y ago
<meta> Title change by mods -- I submitted this post as "Googlers used BigQuery and GitHub to patch thousands of vulnerable projects". After it got to #1 on the front page, mods silently changed the title to "Operation
101.
by fhoffa 10y ago
Good catch. It seems like an artifact of working and editing a query until they got what they wanted - certainly not a BigQuery restriction. (like this https://www.youtube.com/watch?v=cO1a1Ek-HD0 ) Note that the published qu
102.
by fhoffa 10y ago
This is one of the most impactful projects I've seen built using the GitHub source on BigQuery dataset (since we published it). If you want to see other use cases - I've collected plenty of other stories from multiple parties at:
103.
Operation Rosehub – patching thousands of open-source projects(opensource.googleblog.com)
727 points by fhoffa 10y ago|117 comments
104.
by fhoffa 10y ago
"In this competition, you are challenged to develop classification algorithms which accurately assign video-level labels using the new and improved YT-8M V2 dataset. The dataset was created from over 7 million YouTube videos (450,000 h
105.
Kaggle Challenge: YouTube-8M Video Understanding (7M Videos+vectors)(kaggle.com)
2 points by fhoffa 10y ago|1 comments
106.
by fhoffa 10y ago
Blind allocation? When I joined Google I was given 4 teams in 2 different locations to choose. I had lunch with each of the teams, and chose the one that better suited my style. To be fair, your experience at Google will depend a lot on wha
107.
The top weekend languages – this time according to GitHub commits(medium.com)
3 points by fhoffa 10y ago|0 comments
108.
by fhoffa 10y ago
Find Evernote's technical take on their series of blog posts: - https://blog.evernote.com/tech/2017/02/08/part-1-evernote-se...
109.
by fhoffa 10y ago
How about the BigQuery ones? http://demo.redash.io/ works great with BigQuery.
110.
by fhoffa 10y ago
Whoa, you're right. To prove the point to myself I went to search on all reddit comments during 2016-11 (waiting for 2016-12 now). http://imgur.com/a/W1JuE The most popular "disclaimer:" was "Discla
111.
by fhoffa 10y ago
Related: I've been collecting this and all other relevant articles about Apache Beam on https://reddit.com/r/dataflow/ . Disclaimer: I'm Felipe Hoffa, and I work for Google Cloud. http://twitte
112.
by fhoffa 10y ago
Numbers on the post are weird. 'facebookincubator/create-react-app' got 18187 stars in 2016 (17857 when removing duplicates). https://docs.google.com/spreadsheets/d/1aDlXrk3U1z5s0-1Is8KH...
113.
by fhoffa 10y ago
Thanks! The full query joining both result sets gets more interesting: #standardSQL SELECT *, real_rank-rank diff_rank FROM ( SELECT a.id, a.name, a.num_stars, b.num_stars removing_dups, b.num_stars-a.num_stars diff, ROW_NU
114.
by fhoffa 10y ago
You can try it in the next 5 minutes! https://www.reddit.com/r/bigquery/comments/3dg9le/analyzing_... BigQuery is always ready for your queries. One free terabyte of analysis each month. No credit card n
115.
by fhoffa 10y ago
Since they didn't publish their data source, let me add a useful note: How to count the number of stars using GitHub Archive and BigQuery. Naive query: #standardSQL SELECT repo.id, ANY_VALUE(repo.name) name, COUNT(*) as num_stars
116.
by fhoffa 10y ago
I guess my queries linking the dataset to HN posts contributed to this post success :)
117.
by fhoffa 10y ago
If multi-login doesn't work, try using different profiles on Chrome. It works better :) https://support.google.com/chrome/answer/2364824?co=GENIE.Pl...
118.
Using load shedding to survive a success disaster - CRE life lessons(cloudplatform.googleblog.com)
51 points by fhoffa 10y ago|15 comments
119.
by fhoffa 10y ago
Looking forwards to your always inspiring posts! Let me know how I can help.
120.
by fhoffa 10y ago
Can do :)

More ›