3 ms·

I read the Twitter post but did not understand what is happening. Can someone please explain.

by hi41 7y ago

ProAm 7y ago
Apple employees are using their product, downloading lots of data, not paying for any of it, and the OP doesn't like it or can afford it.
- microtherion 7y ago
  I don't think it's employees as such — even Apple does not have THAT many machine learning people, and they wouldn't download models daily. Maybe a server farm, where each instance downloads a model when spinning up?
  - phire 7y ago
    It sounds like a misconfigured build pipeline which re-downloads the model for every single build.
  - hinkley 7y ago
    In the last days of my time spent in the XML salt mines, I got in on a conversation with the web masters at w3.org. You would not believe how many people and how many libraries pull from primary sources directly instead of using local copies of common resources. I found this conversation because I'd just finished fixing that in our code and taking about 5 minutes off the build process. Let me restate that: We were spending 5 minutes just downloading schema files. In an automated build. Every time, sometimes on several machines at once. At one point we were trying to convince him that intentionally slowing all requests down by say 500 ms would get the attention of people who were misbehaving. Anyone who was downloading it once and caching would hardly notice the 500 ms. Those running it once per task would be forced to figure their shit out.
    - angrygoat 7y ago
      I sometimes wonder about all the additional HTTP load to places like debian.org that must come from Docker builds; I don't have any kind of caching in mine, and every single commit causes CI to go and build images and run tests on them. It's not an issue I really see, but it seems to me that CI infrastructure (Travis, ...) really should have caching proxies in place.
      - hinkley 7y ago
        Several places I've worked have pushed Artifactory on us for various reasons from security to resilience to network outages to bandwidth saving. It's not the worst fate.
- Rebelgecko 7y ago
  Is that normally freely available? Or is Apple accessing data that is publicly accessible but not meant to be shared?

I read the Twitter post but did not understand what is happening. Can someone please explain.

by hi41 7y ago

I read the Twitter post but did not understand what is happening. Can someone please explain.

Apple employees are using their product, downloading lots of data, not paying for any of it, and the OP doesn't like it or can afford it.

microtherion 7y ago
I don't think it's employees as such — even Apple does not have THAT many machine learning people, and they wouldn't download models daily. Maybe a server farm, where each instance downloads a model when spinning up?
- phire 7y ago
  It sounds like a misconfigured build pipeline which re-downloads the model for every single build.
- hinkley 7y ago
  In the last days of my time spent in the XML salt mines, I got in on a conversation with the web masters at w3.org. You would not believe how many people and how many libraries pull from primary sources directly instead of using local copies of common resources. I found this conversation because I'd just finished fixing that in our code and taking about 5 minutes off the build process. Let me restate that: We were spending 5 minutes just downloading schema files. In an automated build. Every time, sometimes on several machines at once. At one point we were trying to convince him that intentionally slowing all requests down by say 500 ms would get the attention of people who were misbehaving. Anyone who was downloading it once and caching would hardly notice the 500 ms. Those running it once per task would be forced to figure their shit out.
  - angrygoat 7y ago
    I sometimes wonder about all the additional HTTP load to places like debian.org that must come from Docker builds; I don't have any kind of caching in mine, and every single commit causes CI to go and build images and run tests on them. It's not an issue I really see, but it seems to me that CI infrastructure (Travis, ...) really should have caching proxies in place.
    - hinkley 7y ago
      Several places I've worked have pushed Artifactory on us for various reasons from security to resilience to network outages to bandwidth saving. It's not the worst fate.
Rebelgecko 7y ago
Is that normally freely available? Or is Apple accessing data that is publicly accessible but not meant to be shared?