Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
mrtimo
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
8 ms
·
31.
▲
by
mrtimo
1y ago
Malloy [1] has a semantic layer [2]... and Model Context Protocol (MCP) support is being added through Publisher [3]. Something to keep an eye on. Seems like a great fit for LLMs. [1] https://www.malloydata.dev/ [2] https:
32.
▲
by
mrtimo
1y ago
No python course?
33.
▲
by
mrtimo
1y ago
how would you use this within open-web-ui locally?
34.
▲
by
mrtimo
2y ago
This is a great lineup. Excited for the "SQL replacement" talks. Malloy is currently my favorite because of it's semantic nature. Define all the joins, measures, dimensions up in the source, and use them as needed. Makes for
35.
▲
by
mrtimo
2y ago
Malloy is a newish data language with semantic models... Perhaps what semantic SQL would look like: https://www.malloydata.dev/
36.
▲
by
mrtimo
2y ago
Enjoyed his roundup in the "Shoving Ducks into Everything" section. DuckDB is a great tool. In April 2020, the creator of DuckDB gave a talk at CMU. In the beginning he makes a convincing argument (in 5 minutes) why data scientist
37.
▲
by
mrtimo
2y ago
In the aerial view image (the 3rd image on the page) you can see the walled city next to a park in the foreground). The park is still there today (and now the remnants of the walled city are absorbed into the park). Here is an aerial view t
38.
▲
by
mrtimo
2y ago
I love using the Malloy vscode extension to explore .csv and .parquet. Malloy embeds duckdb - and is a fresh take on analytic SQL. https://www.malloydata.dev/
39.
▲
by
mrtimo
2y ago
Here is the report - released 16 hours ago - that this news piece comes from: https://www.canada.ca/en/health-canada/services/publications...
40.
▲
by
mrtimo
2y ago
Just downloaded all the data as a 2.45GB csv file. It took about 10 minutes to "export", before the download started.
41.
▲
by
mrtimo
2y ago
Thanks for this background. What's the best way to download your data, or the feds data?
42.
▲
by
mrtimo
2y ago
I think I would miss the the semantic data modeling of malloy, and Malloy is definitely easier to read and write IMHO, in part because of the semantic data modeling. I would also miss the nest feature of Malloy, and the way it handles time
43.
▲
by
mrtimo
2y ago
Thanks for letting me know about this! I do the same thing... DuckDB loads CSVs very quick and easy. Malloy uses duckDB and can work in VScode or vscode.dev or the vscode built into github. So, you can analyze large .csv files in any of th
44.
▲
by
mrtimo
2y ago
Don't miss the link to the full res cross-section: https://staging.cohostcdn.org/attachment/11357255-b6b9-4a57-...
45.
▲
by
mrtimo
2y ago
I see Malloy as an analysis tool like Pandas, PowerBI, Tableau, or Looker. It seems like most people write SQL to get "All the data" and then take it to an analysis tool for further study. With Malloy you can do the analysis on yo
46.
▲
by
mrtimo
2y ago
> SQL is great at expressing simple needs very well, but in more advanced cases, it can get "mind-twistingly complicated" even for a mathematically included brain. I have found Malloy[1] to be easier to read and write, even for
47.
▲
by
mrtimo
2y ago
I've downloaded many csv files that were mal-formatted (extra commas or tabs etc.), or had dates in non-standard formats. Parquet format probably would not have had these issues!
48.
▲
by
mrtimo
2y ago
.parquet files are completely underrated, many people still do not know about the format! .parquet preserves data types (unlike CSV) They are 10x smaller than CSV. So 600GB instead of 6TB. They are 50x faster to read than CSV They are an &q
49.
▲
by
mrtimo
2y ago
How is this compare with parquet format?
50.
▲
Finding John Stockton
(deseret.com)
3 points
by
mrtimo
3y ago
|
0 comments
51.
▲
by
mrtimo
3y ago
You don't even need a database file if you use Malloy, just a .parquet file or .csv file will work. Think of a .parquet file as a python dataframe saved as a file. DuckDB combined with Malloy are a powerful combo. If you like writing S
52.
▲
by
mrtimo
3y ago
I wanted my students to be able to run open source models. Easiest way was using ollama, and ollama web ui (now open web ui) on google cloud for .18 cents an hour with a 4-core nvidia and 16 GB of ram on a spot instance. I created a tutoria
53.
▲
by
mrtimo
3y ago
would love to learn more about what you are doing with supermarket prices
54.
▲
by
mrtimo
3y ago
It would be really cool if you guys supported Malloy. Maybe you already do? https://www.malloydata.dev/
55.
▲
by
mrtimo
3y ago
I am business prof. I wanted my students to try out ollama (with web-ui), so I built some directions for doing so on google cloud [1]. If you use a spot instance you can run it for 18 cents an hour. [1] https://docs.google.com&#x
56.
▲
by
mrtimo
3y ago
this is amazing -- thanks. side note: when you want to get more data you can just get the new data, and save it as hacker-news-part-2.parquet - then when you use duckdb / malloy you can read them as a glob (hacker-news*.parquet) - and
57.
▲
by
mrtimo
3y ago
I thought you were joking about the 38 million requests! wow! Have you heard about .parquet files? Save it as a parquet and share the link.
58.
▲
by
mrtimo
3y ago
where can i download the data behind this?
59.
▲
by
mrtimo
3y ago
I teach an MBA class on a similar subject. The students like a book called "Adventures of an IT leader". It's a fun read that students with work experience can relate to. And students without work experience can learn a lot f
60.
▲
by
mrtimo
5y ago
This is great. I'm a college prof, and this is perfect for teaching students how to use APIs.
More ›