21 ms·
SQL Notebook
- probdist 9y agoLooks pretty neat. Reminds me a bit of Linqpad, https://www.linqpad.net/ https://www.linqpad.net/ which I've also never used.
- macca321 9y agoLINQPad is amazing. I have a full licence and have persuaded a couple of companies to buy site licences before. It's would be great if there was some kind of full version trial so people could try it with full intellisense and package manager support.
- hjalle 9y agoYeah, LINQPad is great! I use it for so many weird cases, everything from rather complex scraping with phantomjs to trying out things like regexs. I've saved small scripts that make it easier to get into new projects, such as making lists of files that have been changed the most and people who have the most commits etc.. Really recommend it for .NET devs.
- Pxtl 9y agoThere are good F/OSS versions of LinqPad - see Arnova CShell and RoslynPad.
- ckdarby 9y agoCan't exactly see the value this brings that Apache Zeppelin doesn't already offer. https://zeppelin.apache.org/ https://zeppelin.apache.org/
- buckbova 9y agoIt's a standalone app.
- mwexler 9y agoIsn't this self hosted, running on the windows client, so you can quickly work with small datasets that are local? Vs. Zeppelin which is hosted (or, if local, is running via docker), and would require uploading the data? If you already have a trusted Zeppelin or Jupyter or other notebook, then this may not be needed, but if you want to keep all local, this may be a quick and easy alternative... assuming you like SQL.
- skybrian 9y agoI haven't used it but it looks like Zeppelin is a Java web application that's available on localhost by default. No docker needed, just download and run. https://zeppelin.apache.org/docs/0.6.0/install/install.html https://zeppelin.apache.org/docs/0.6.0/install/install.html
- mwexler 9y agoFair enough; I've never used it locally as I always am using hosted versions. Still, lots of extra overhead to just beat up some tables in sql. If you think you would do more beyond that, however, makes sense to try a notebook...
- catawbasam 9y agoBetter SQL integration and better browsing of tabular data, maybe?
- tomc1985 9y agoNot a web app? That's huge.
- recursive 9y agoIt's got a straight-forward installer that's 6MB. I was able to run it and use it in seconds. Zeppelin has source available, or a binary package with a spark interpreter, or a binary package with "all interpreters". That one is 712MB. If I just want to use it, I still don't understand what to actually do. I'm downloading the big .tgz as we speak. Following the installation guide, A:\TEMP\zeppelin\zeppelin-0.7.1-bin-all>bin\zeppelin.cmd Log dir doesn't exist, create A:\TEMP\zeppelin\zeppelin-0.7.1-bin-all\logs Pid dir doesn't exist, create A:\TEMP\zeppelin\zeppelin-0.7.1-bin-all\run The system cannot find the path specified. A:\TEMP\zeppelin\zeppelin-0.7.1-bin-all>mkdir logs A subdirectory or file logs already exists. A:\TEMP\zeppelin\zeppelin-0.7.1-bin-all>bin\zeppelin.cmd The system cannot find the path specified. And now I'm completely stuck. So the value in this compared to Zeppelin is that it's small, straight-forward, and simple.
- petercooper 9y agoSays more about how long I haven't used a MS OS than anything but I initially had a 5 second "why are they installing it on their floppy drive?" moment there :-)
- dylz 9y agoWhat's a floppy drive?
- temp246810 9y agoHa - yes DOS commands hold a special place in my heart so to speak. The very first "terminal" like thing I learned as a really young kid was how to load a floppy disk, which usually just meant typing a:. Memories.
- petercooper 9y agoDitto. For me A: was always a 3.5" drive with B: being, optionally, a 5.25" drive (if installed). Not sure how universal that was though. I do like how C: has mostly hung on though.
- 9y ago
- derimagia 9y agoLooks like some web app? There are like a thousand of those
- grouseway 9y agoNeat. -How about import from clipboard (useful for cut and paste from excel) -It doesn't seem to recognize tab delimiters in a .txt file. Maybe the import window should have a delimiter selector? -Does it have a crosstab/pivot tool? Most sql dialects are lacking here because they make you explicitly define crosstab columns which is a pain for exploration work.
- bobochan 9y agoThis looks very interesting. I recently had to teach a series of workshops on SQL and I was trying to figure out the best system to allow students to independently work with small datasets without having to install any software. I found Alon Zakai's absolutely fantastic version of SQLite in JavaScript here: https://github.com/kripken/sql.js https://github.com/kripken/sql.js I coupled that library with a CodeMirror editor and got a working web based environment very quickly.
- j_s 9y agoIs there anything open-source similar to your web-based SQL IDE including sample data for teaching? Something from the first of these sites may be adaptable: · https://sqlbolt.com https://sqlbolt.com · https://www.sqlteaching.com https://www.sqlteaching.com · https://www.khanacademy.org/computing/hour-of-code/hour-of-sql https://www.khanacademy.org/computing/hour-of-code/hour-of-s... · https://pgexercises.com https://pgexercises.com | https://news.ycombinator.com/item?id=6893333 https://news.ycombinator.com/item?id=6893333 · http://sqlzoo.net http://sqlzoo.net · http://academy.vertabelo.com http://academy.vertabelo.com
- bobochan 9y agoI did not see anything when I started putting it together, but I already had a number of datasets that I put together for illustrating specific points. My favorite is a list of pairs of airport codes and the distances between them. This is a simple table, but students can have a lot of fun with a challenge like "Be the worst possible travel agent you can be. Find an itinerary from NYC to CDG, with a maximum of four stops, that will cover the most miles." Hilarity ensues as we look at the result, but it is challenging enough for beginners learning about joins, etc. The other great thing about this type of setup is that students can feel free to experiment with deleting records and doing all kinds of things in SQL knowing that they can immediately restore everything to the initial state by hitting refresh. The last component that I think helped the class was adding an anonymous "share" button that allowed students in the class to submit the contents of their editor so that I could run it for the whole class and we could talk about the trade-offs of different approaches.
- 9y ago
- krylon 9y agoAt work, I routinely have a copy of SQL Server Management Studio open for the odd ad-hoc query I need to run against our ERP system's database. This tool looks like it might be a useful replacement for this purpose, especially if it can handle CSV data, as well.
- bendykstra 9y agoI'm curious why it is not possible to import data from an SQLite file.
- Dnguyen 9y agoIn my daily work I often have the need to analyze excel and csv files from clients. I use http://harelba.github.io/q/ http://harelba.github.io/q/ and it worked most of the time. But this one seems promising. Especially being able to query data from a file and join with data from a database.
- j_s 9y agoCSV tool recommendations | https://news.ycombinator.com/item?id=7175830 https://news.ycombinator.com/item?id=7175830
- TeMPOraL 9y agoOuch, that would be very useful to me had I known about it two months ago, when I was exploring the database dump from my old Wordpress blog (I'm finalizing the process of re-launching it as a static site). I managed though, by combination of MySQL Workbench and Common Lisp REPL. Anyway, bookmarking for the next time I'll need to play with relational data.
- yread 9y agoHmm looks nice but last commit was 8 months ago https://github.com/electroly/sqlnotebook https://github.com/electroly/sqlnotebook
- bognition 9y agoWindows only is a shame, nearly all devs I know use OSX or linux.
- egeozcan 9y agohttps://insights.stackoverflow.com/survey/2016#technology-desktop-operating-system https://insights.stackoverflow.com/survey/2016#technology-de...
- infogulch 9y agoHoly crap, all windows combined is more than double Mac. And it still edges out Mac+Linux.
- k3nx 9y agoHow does an SO survey change the view of the comment? If they use Linux and know three other developers two that use a Mac and one on Windows isn't the comment still true? From what they see more folks use non-Windows. Also, not every developer in the world filled out the SO survey. The comment was lamenting that it was Windows Only, I think that's still relevant.
- gdulli 9y agoThe comment can lament whatever it wants, but its anecdotal evidence is clearly implying a premise that's proven false by actual data that shows a majority of developers use Windows.
- fizwhiz 9y agoThe `Who’s Looking for a New Job?` unicode blunder on that article's section made me chortle especially after you realize the founder published this article years ago: https://www.joelonsoftware.com/2003/10/08/the-absolute-minimum-every-software-developer-absolutely-positively-must-know-about-unicode-and-character-sets-no-excuses/ https://www.joelonsoftware.com/2003/10/08/the-absolute-minim...
- electroly 9y agoHello everyone! Author here. I didn't expect anyone to find this repo, much less post it on Hacker News! This project is inactive for two main reasons: - SQLite is not a great general-purpose SQL engine. Poor performance of joins is a serious problem that I couldn't solve. The virtual table support is good but not quite good enough; not enough parts of the query are pushed down into the virtual table interface to permit efficient querying of remote tables. Many "ALTER" features are not implemented in SQLite which is a tough sell for experimental data manipulation. - T-SQL, the procedural language I chose to implement atop SQLite, is not a great general-purpose programming language. Using C# in LINQpad is a more pleasant experience for experimentally messing around with data. R Studio is a good option if you need statistical functions. I think several good solutions in this problem space exist. A local install of SQL Server Express can be linked to remote servers, allowing you to join local tables to remote ones. That setup serves nearly all of SQL Notebook's use cases better than SQL Notebook does. LINQpad is also very convenient for a lot of use cases. I appreciate the interest! I may spin off the import/export functionality into its own app someday, as I had a lot of plans in that area, but I think SQL Notebook as it stands is a bit too flawed to develop fully.
- j_s 9y agoSounds like a summary of this comment should be added to the README / web page as a disclaimer!
- infogulch 9y agoI feel like rewriting this on top of SQL Server Express would still be valuable. Setting up and managing linked servers manually, especially with non-SQL Server databases can be a pita especially considering managing their drivers etc. Also, SQL Server is awful at importing/exporting data directly. Almost all forms are broken in various ways and are a source of endless grief. The only reliable built-in way is to use SSIS which is like using a 200-ton tank for a paperweight.
- jimktrains2 9y ago> I feel like rewriting this on top of SQL Server Express Why choose a proprietary engine? Why not use PostgreSQL or even MySQL?
- kencausey 9y agoAnyone else understand what they are referring to in the Getting Started notebook about a 'CREATE menu'? I don't see it anywhere.
- iagovar 9y agoWould this app be nice for a beginner with DB's for data analysis?
- daveorzach 9y agoIs there any Windows SQL software that can use system/machine ODBC data sources? My company uses OpenLink's ODBC drivers to access our main database (Progress OpenEdge.) I have no problem using Python, Pandas, and pyodb to connect to the data base but it isn't the best environment to develop queries.
- eterm 9y agoMySQL workbench (it is available as a free download but you have to dodge quite a few "No I really mean I want the free community ed" screens) is quite good for that. https://www.mysql.com/products/workbench/ https://www.mysql.com/products/workbench/ There are versions for linux and windows and iirc it supports any ODBC connection as well as out of the box SSL tunnelling for mysql/postgres/etc.
- agentultra 9y agoI've always wanted a nice SQL-oriented "notebook" type of application. I get something of this experience in Emacs via `org-mode`, `sql-mode`, and `ob-sql-mode` minus the data-importing functionality... though with babel it's probably doable in a code block using a script. Bonus: org-mode lets you export to many formats which makes sharing results quite easy.
- nrjames 9y agoI generally use the Firefox SQLite Manager extension when I need to explore SQLite databases. It serves its purpose pretty well, though it has some annoyances and UI quirks. https://addons.mozilla.org/en-US/firefox/addon/sqlite-manager/ https://addons.mozilla.org/en-US/firefox/addon/sqlite-manage...
- mythrwy 9y agoIn a terminal, `sqlite3 mydb.` works pretty well also. I find this generally a lot faster than GUI tools for quick peek or some queries (although for complex relations and visualization a good GUI is the thing to have). Not a huge MS fan but SQL Management Studio is pretty good (don't know about sqlite support.. I bet it's possible though). .tables (list tables). .schema <table> (show table schema). .help shows commands. Or just enter some SQL to get results.
- voltagex_ 9y agoIt'd be really cool to use SSMS for SQLite. It's possible but not nice: https://superuser.com/questions/138787/is-it-possible-to-open-a-sqlite-database-from-within-microsoft-sql-server-manage https://superuser.com/questions/138787/is-it-possible-to-ope... DataGrip from Jetbrains looks promising but the connect/disconnect/setup process is really painful.
- carlosgg 9y agoI will check it out. You can also use R notebooks to embed SQL code in notebook format. https://blog.rstudio.org/2016/10/05/r-notebooks/ https://blog.rstudio.org/2016/10/05/r-notebooks/ (scroll down to "Batteries included") I was playing around a bit with it: https://carlosror.github.io/baseball_mysql/ https://carlosror.github.io/baseball_mysql/
- lima 9y agoJupyter/IPython + https://github.com/catherinedevlin/ipython-sql https://github.com/catherinedevlin/ipython-sql is a wonderful workflow for interactive DB exploration.
- dil8 9y agoThis is awesome! Thanks for sharing.
- educar 9y agoVery nice, I have been using https://addons.mozilla.org/en-US/firefox/addon/sqlite-manager/ https://addons.mozilla.org/en-US/firefox/addon/sqlite-manage... so far. Looks like this can replace it.
- stared 9y agoFor having R in notebooks (similar to Jupyter Notebooks) I really recommend http://rmarkdown.rstudio.com/authoring_knitr_engines.html http://rmarkdown.rstudio.com/authoring_knitr_engines.html. As a side benefit, it is easy to ggplot results. :)