remilouf

10 ms·

61.
by remilouf 7y ago
I really recommend Murphy’s “Machine Learning: a probabilistic perspective”. Murphy’s lays the groundwork for understanding how the algorithms work, why and how they could be adapted to the problem you’re dealing with. It takes you from com
62.
by remilouf 7y ago
I will consider that. How about Redshift?
63.
by remilouf 7y ago
Thanks! Do you have any tips on convincing people that SQL is a good paradigm?
64.
by remilouf 7y ago
I was also hired because I also have an affinity (affinity, not expertise) with data engineering and am familiar with development good practices. The idea is not to spend 100% of my time doing this, more like 30%. Business value comes first
65.
by remilouf 7y ago
I think it may come across as trolling :)
66.
by remilouf 7y ago
> Don't ruin it by becoming that cliched new hire that sees all their problems and knows how to make it all better. I don't, which is why I'm asking around. I'm also scheduling chats with people to understand the back
67.
by remilouf 7y ago
You changed my perspective a little bit by asking the right questions. > Moves from an architecture that is clustered for scale (ie. spark) to one that only scales vertically I did a quick estimate of the volume, and we won't reach
68.
by remilouf 7y ago
In this case no one technically competent was here to manage them. There were no expectations.
69.
by remilouf 7y ago
I love SQL. But it hard to get other DS on board who think that 40 lines of Spark is better than a 10 line SQL query. The only thing that worries me with SQL is when having to write UDFs for, say, computing a Z-score. But maybe it's ju
70.
by remilouf 7y ago
Thank you for your answer, it was eye-opening. The story is that they opened that department a year ago and needed buy-in quickly so needed to jump-start it by hiring consultants. Whether hiring consultants was a good idea or not, I underst
71.
by remilouf 7y ago
Thank you for taking the time to answer thoroughly ! > If it is only used by data science team then you can rip apart the solution and work towards a more logical infrastructure where all you are doing is cleansing, normalizing and deriv
72.
by remilouf 7y ago
Well, when several people are working on the same project they "share" the transformed data by connecting to the same EC2 instance. The way data is transformed is via 4 scripts, 2 notebooks and a bunch of manual operations, so no
73.
by remilouf 7y ago
I did use BigQuery in the startup I was working for before, and it worked wonders for our 12Tb of data. I think it would be a bit overkill in our situation---even though not having to manage a DB is great.
74.
by remilouf 7y ago
For some use cases I would totally agree :)
75.
Ask HN: How do I improve our data infrastructure?
163 points by remilouf 7y ago|104 comments
76.
by remilouf 7y ago
I second that. I find that it helps junior dev find the sweet spot in commit granularity.
77.
by remilouf 7y ago
I feel it reduces cognitive load, like proper formatting of code. Do you enforce consistent code formatting in your codebase (using CI, maybe)? If so, why wouldn’t you do that with commits?
78.
by remilouf 7y ago
I don’t completely agree. By taking the time to write commit messages you are documenting your code at a fine-grained level. Think of it like a short email that explains to your (future) colleagues and future self what you changed and espec
79.
by remilouf 8y ago
This. I was in an extreme situation like you were (boss abusive with everyone in the company, constant threats and sometimes physical abuse). - First, see if you can find other employees in the same situation. Being a group helped us. - D
80.
by remilouf 8y ago
My trick is very simple and very low-tech. Take a piece of paper and a pen and draw a diagram that sums up the big picture of what you are trying to achieve (architecture of the software you’re writing for instance). Take as long as you nee
81.
by remilouf 8y ago
By being explicit about the assumptions they make. It does not mean they are not biaised, but that you at least know what poison you chose.
82.
by remilouf 8y ago
And I believe you. In the end, no language is better than another one in absolute. It all depends on the use case. In mine, Elixir and Go happen to outperform everything else I know but they are probably terrible somewhere else.
83.
by remilouf 8y ago
For a MVP you’re right. But a few years (months) down the line, you may find that some alternatives scale better. Elixir, for instance.
84.
Ask HN: What do you use for remote configuration on your mobile app?
1 points by remilouf 8y ago|1 comments
85.
by remilouf 8y ago
As someone who also develops in Python and Nim, I respectfully disagree. There are a lot of use cases where I would pick them over Go, but the important term here is “production grade”. Sure, you can bootstrap something really quickly in Py
86.
by remilouf 8y ago
I don’t know how this works in the US but what comes to mind is voting rights. It may seem unimportant now, but might come and bite you in the a later. It really depends on your relationship with this person.
87.
by remilouf 8y ago
Maybe not on the “life is short” metric. It is insanely fast to write production grade code in Go :)
88.
by remilouf 8y ago
“This is water” the transcript of a commencement speech that David Foster Wallace gave. Probably the best thing he ever wrote (and shortest :) ).
89.
by remilouf 8y ago
Erlang and Go. I have a background in data science, so have a lot of experience with Python. I’d always wanted to do more backend stuff: push my models in productions, do the ETL work myself... But quickly got frustrated with Python. Go and
90.
by remilouf 8y ago
Before even considering it I would ask the CEO why she’s leaving and the employees. Some people have very good reasons to leave a sinking ship (family being the most common), but others leave because of systemic problems in the company. I

More ›