5 ms·

If anyone from these startups is here on HN, I would love to hear your thoughts on the following: 1. How are you dealing with TTFX when deploying your code? If

by ubj 4y ago

If anyone from these startups is here on HN, I would love to hear your thoughts on the following: 1. How are you dealing with TTFX when deploying your code? If using PackageCompiler/StaticCompiler, is binary size an issue? 2. Are you using solely Julia, or a combination of Julia + other languages? 3. What unique value is Julia offering your startup that is difficult to find in other languages?

logankilpatrick 4y ago
When I worked at Beacon biosignals briefly in 2020, they had Simon Danish (the creator of Makie there full time deploying plots/makie in the browser). One point 2, you should check out Julius Tech which is bridging the multi language future using Julia through their graph computing tool. Other companies like RelationalAI are building on top of Julia but also have their own new language called Rel.
Loic 4y ago
TTFX - the time-to-first whatever a package does most[0]. [0]:https://discourse.julialang.org/t/taking-ttfx-seriously-can-we-make-common-packages-faster-to-load-and-use/74949 https://discourse.julialang.org/t/taking-ttfx-seriously-can-...
thetwentyone 4y ago
Jumping the gun slightly, but TTFX likely about to get a lot better (5x+ improvement in times) in the next version (1.9). Via cachine of the native compiled code. https://github.com/JuliaLang/julia/pull/47184#issuecomment-1337079281 https://github.com/JuliaLang/julia/pull/47184#issuecomment-1...
- CyberDildonics 4y ago
  I've been hearing about improvements for the last 8 years. It has been a constant complaint and a constant broken promise.
  - adgjlsfhk1 4y ago
    Since 1.0 it has gotten way better. There's still work to do (obviously) but there has been continual improvement.
    - galangalalgol 4y ago
      My concern for TTFX is the case when X is something infrequent but sensitive to latency? This a ridiculous example but when it is time for the anti-collision feature on my car to kick in, I want it to run, not compile. I think the right answer is to run a bunch of tests to get all the paths compiled and then build a new system image. But I haven't found a ton of guidance on how to do that. Seems like a perfect pipeline task.
      - leephillips 4y ago
        That’s the idea. Here’s an example: https://discourse.julialang.org/t/a-julia-dataanalysis-sysimage-from-packagecompiler-its-so-easy-you-should-do-it-too/68127 https://discourse.julialang.org/t/a-julia-dataanalysis-sysim...
    - lambdatronics 4y ago
      I think Jevon's paradox is also hitting to some extent, coupled with the ecosystem getting bigger, so a typical project may have more transitive dependencies behind it. The functionality is going up, and the speed of compilation is going up, but the total latency is staying similar or increasing, in my experience.
      - adgjlsfhk1 4y ago
        that's definitely possible. I'm somewhat hopeful that some changes in 1.9 will let us cut back on transitive dependencies a lot, but it will take a few months to know for sure.
  - thetwentyone 4y ago
    I'm not sure that there's been any "promises" to break. Folks have been saying that it's possible but it'll just take time and effort.
etik 4y ago
We (metalenz.com) use Julia extensively in our optical design/simulation/modeling workflows: 1. Design team keeps live sessions during interactive work, otherwise launches on virtualized servers (and things take sufficiently long to compute TTFX is a rounding error) 2. Above mentioned team is exclusively Julia. Julia shows up in other things we do (low-level computer vision), but not dominant nor exclusive 3. High performance & expressive programming and flexible autodiff system for scientific computation

by ubj 4y ago

logankilpatrick 4y ago

When I worked at Beacon biosignals briefly in 2020, they had Simon Danish (the creator of Makie there full time deploying plots/makie in the browser). One point 2, you should check out Julius Tech which is bridging the multi language future using Julia through their graph computing tool. Other companies like RelationalAI are building on top of Julia but also have their own new language called Rel.

Loic 4y ago

TTFX - the time-to-first whatever a package does most[0]. [0]:https://discourse.julialang.org/t/taking-ttfx-seriously-can-we-make-common-packages-faster-to-load-and-use/74949 https://discourse.julialang.org/t/taking-ttfx-seriously-can-...

thetwentyone 4y ago

Jumping the gun slightly, but TTFX likely about to get a lot better (5x+ improvement in times) in the next version (1.9). Via cachine of the native compiled code. https://github.com/JuliaLang/julia/pull/47184#issuecomment-1337079281 https://github.com/JuliaLang/julia/pull/47184#issuecomment-1...

CyberDildonics 4y ago
I've been hearing about improvements for the last 8 years. It has been a constant complaint and a constant broken promise.
- adgjlsfhk1 4y ago
  Since 1.0 it has gotten way better. There's still work to do (obviously) but there has been continual improvement.
  - galangalalgol 4y ago
    My concern for TTFX is the case when X is something infrequent but sensitive to latency? This a ridiculous example but when it is time for the anti-collision feature on my car to kick in, I want it to run, not compile. I think the right answer is to run a bunch of tests to get all the paths compiled and then build a new system image. But I haven't found a ton of guidance on how to do that. Seems like a perfect pipeline task.
    - leephillips 4y ago
      That’s the idea. Here’s an example: https://discourse.julialang.org/t/a-julia-dataanalysis-sysimage-from-packagecompiler-its-so-easy-you-should-do-it-too/68127 https://discourse.julialang.org/t/a-julia-dataanalysis-sysim...
  - lambdatronics 4y ago
    I think Jevon's paradox is also hitting to some extent, coupled with the ecosystem getting bigger, so a typical project may have more transitive dependencies behind it. The functionality is going up, and the speed of compilation is going up, but the total latency is staying similar or increasing, in my experience.
    - adgjlsfhk1 4y ago
      that's definitely possible. I'm somewhat hopeful that some changes in 1.9 will let us cut back on transitive dependencies a lot, but it will take a few months to know for sure.
- thetwentyone 4y ago
  I'm not sure that there's been any "promises" to break. Folks have been saying that it's possible but it'll just take time and effort.

etik 4y ago

We (metalenz.com) use Julia extensively in our optical design/simulation/modeling workflows: 1. Design team keeps live sessions during interactive work, otherwise launches on virtualized servers (and things take sufficiently long to compute TTFX is a rounding error) 2. Above mentioned team is exclusively Julia. Julia shows up in other things we do (low-level computer vision), but not dominant nor exclusive 3. High performance & expressive programming and flexible autodiff system for scientific computation