8 ms·
Pushup: a new compiler for making web apps in Go
- paulsmith 4y agoPushup creator here. We're interested in feedback on the design. Pushup introduces a new lightweight template syntax that mixes Go code and HTML in the same page; pages are then compiled down to pure Go, relying on the net/http package. Pushup uses file-based routing, so adding a page adds a route to your app. The template language has an "inline partials" feature to make it easier support for modern hypermedia libraries like htmx in mind. Would love to know what the Go web development community thinks. Here is a short demo of Pushup in action: https://www.youtube.com/watch?v=nkyiATkZ4Js https://www.youtube.com/watch?v=nkyiATkZ4Js
- iamgopal 4y agoAlso try to give usable web app ( todo ? ) hostel somewhere if possible.
- paulsmith 4y agoYes, we need to do that - I'll populate them here eventually https://pushup.adhoc.dev/docs/guides https://pushup.adhoc.dev/docs/guides
- KRAKRISMOTT 4y agoDo you have any hosted demos?
- paulsmith 4y agoThe main project site is a Pushup app: https://pushup.adhoc.dev https://pushup.adhoc.dev (look in the `docs` directory in the repo for the source code for the site) There is a small demo of the inline partials feature here (click on the "view the Pushup source for this page" link at the bottom): https://pushup-htmx-template-fragments.fly.dev/demo https://pushup-htmx-template-fragments.fly.dev/demo
- savolai 4y agoI’m Finnish. The caret is not always easy to type in my experience on international keyboards. Not sure what the added value is of creating yet another convention here, as there are so many already with each new templating language.
- paulsmith 4y agoThat's good feedback, thank you. My US-centric eye didn't consider that.
- thiht 4y agoSame on a French keyboard, trying to type `^if {` will result in `îf {`
- derkoe 4y agoOh yes it's pretty hard to type on a German keyboard as well. In most editors you will need two keystrokes.
- fulafel 4y agoBut don't you need 4 keystrokes for the common alternative, {} enclosed template expressions? Same as french, nordic, and probably lots of other european intl layouts. (Or even better against the {{ }} ones requiring 6)
- Zababa 4y ago"{" on a french keyboard is two key presses but at the same time (alt gr and 4), while ^ is two key presses one after the other, which makes it a bit slower. Most editors will also insert the corresponding } when you create a {. That makes in my experience {} faster than ^ and {{}} as fast as ^. {} is still a common complaint in my circle of programmer friends and everyone has seriously thought even once about switching to an english/american keyboard, but then there's the issue of switching back when writing stuff in french (é by itself almost ruins the idea).
- mholt 4y agoHey cool! Caddy plugin? :D I might be quite interested in this.
- paulsmith 4y agoWe talked about exactly that! Yes, let's
- jerf 4y ago"Pushup uses file-based routing, so adding a page adds a route to your app." Make sure to have a clean way of escaping that and having some richer concept of how to route. This was the original way routing worked, back in the ASP (not ASP.net, the predecessor), CGI, original PHP days. We moved away from it for good reasons. It works well early but has scaling problems over time. I'm not saying don't have it as a default per se... just make sure you have a "if you need to do something else here's how to override it". I also strongly advise against trying to guess what the overrides might be and building special cases for "the three things I think people may need to do beyond thsi". I've got a router in my system that looks at client-side TLS certificates if it comes from certain IPs and uses LDAP authentication if it comes from certain other IPs, and does different things if the auth fails for each case. You'll never be able to guess all the possible ways people want to route. You need to make sure you don't lock the users into this so hard they can't escape except by leaving your framework entirely. Edit: Also, I didn't look into this deeply, but if you throw away the ability to have middleware on specific routes you've really caused a big problem. The Go ecosystem is fairly dependent on that.
- robertlagrant 4y agoI have the same instinct (JSP / JSF had the same concept) but I must say, making pages as files in next.js is really nice. You can have all your dynamism within them, but having a simple way to do overall routing is lovely.
- jerf 4y agoIt is nice. It is easy. There's a reason we started there. Then, suddenly after a certain amount of scaling, it isn't. And it's not like that's an impossible situation either, but you end up with all the consequences of building a framework to do X and then having to build an inner platform[1] to do some other Y inside of X instead. [1]: A technical term: https://en.wikipedia.org/wiki/Inner-platform_effect https://en.wikipedia.org/wiki/Inner-platform_effect
- robertlagrant 4y ago
- digitalsankhara 4y agoThis looks really good. I like the compilation to a single binary. I'm already using Htmx with Flask for routing/templating. File based routing with a page as the unit of functionality sit well with me. The use of caret to denote Go code is quite clean, but given well formed HTML, could the parser detect anything not inside HTML tags as Go code and thus remove the need for a caret outside of HTML. I will be trying this out. Thanks for this project.
- fprog 4y agoLove this idea. And I’ve been looking for something exactly like Pushup. Really excited to try it out.
- oppositelock 4y agoThis is very neat, but you are delving into a very complex world, as you are well aware. In your video, you have generated static server side pages, without any JS, where your annotated HTML uses the embedded go to generate static HTML. This is much nicer syntactically than using the Go html/template engine, but it seems roughly equivalent in expressive power. Are you converting your "up" syntax into go templates with the Go expressions extracted into compiled Go code, referenced be the templates, out of curiosity? If so, the way you've transparently handled interleaving (such as html elements in the for loop) is really cool. How would your go scripting interact with JS? For example, say that I have a backend API that the fronted calls into. In your design, would I call out into Go to perform the http request, or would I do this in JS? I'm sure both would work - since the Go request would be handled server side and simply slow down static page generation, but it seems like calling into Go might not be the right thing to do for a more responsive AJAX app. Do you envision mixing Up/JS in the same pages? Can I do crazy stuff like use JS to insert a variable (by value probably) into your Go code, or vice versa? Over the years, I've learned that web front ends are positively bonkers in the kinds of things they want to do, and when you are the developer of any kind of frameworks, you end up suffering greatly if you insert yourself into middle of that ecosystem, since you will be asked to support features that you never dreamed of. If you support them, the framework gets more use, if you don't, the cool kids move onto other things. I've tried to tackle a much simpler problem with a project of my own [1], which is a backend server code generator to make implementing JSON models more easily from an OpenAPI spec, and I've found that even in this relatively simple concept, the limitations of a strictly, statically typed language like Go end up running into incredible complexity due to the dynamic nature of web frontends and JSON. Outside of trivial strings and numbers, you start running into the limits of the Go typing system. Anyhow, good luck, this is very cool and it seems like a fun thing to play with. 1: https://github.com/deepmap/oapi-codegen https://github.com/deepmap/oapi-codegen
- teejays 4y agoIt's a nice idea. I'm going to dig a little deeper in the design and developer experience choices. That being said, I am a little curious -- what is the intended use case here? The reason I am asking is because I've been doing lots of web-development, with Go as a primary backend lang, for the last 9 years but never have I seriously felt the need to do serve the UI from Go. I guess there is some advantage reducing n (number of tools/languages in a stack) - but is there any other motivation behind it?
- paulsmith 4y agoThe imagined use-case for Pushup is the same niche that Rails, Django, and Flask apps occupy, which is a wide range but broadly I would describe as page-oriented, HTML-first, server-side frontends. I started Pushup because I asked myself, I like programming in Go and think (like you) it's great for web backends - but what is holding it back from being a great full-stack web dev language or environment? net/http is a great building block, and html/template is solid, but I felt more was needed. Like opinionated project directory structure, for one. But also the world has changed since 2006 when Rails and Django debuted. Obviously, we live in a world in which React and the SPA is seemingly dominant, but projects like htmx have recently shown that you can achieve modern UI/UX in the browser on a server-side app, which less JavaScript. BTW, more and more JavaScript frameworks, like Remix, are (re-)discovering the value of SSR. I was also motivated to give an old-school mod_php feel of, just add a file and you automatically get a URL route. That's a nice developer experience but also good for long-term project maintenance. Finally I was struck by this essay[1] about the demise of the "mildly dynamic" site. There is a wide diversity of types of sites and apps, from quick experiments and prototypes, small-to-medium sites of many kinds. But also since it's Go, I think it could scale up on performance to large-scale sites, and as a static binary, be nicely suited to edge apps like fly.io. [1] https://www.devever.net/~hl/mildlydynamic https://www.devever.net/~hl/mildlydynamic
- warrentr 4y agoReally great explanation, thanks. I've definitely felt a bit silly spinning up an entire react project for a "mildly dynamic" site
- thefounder 4y agoI don't like it. It looks like early php. This doesnt mean it is bad. I'm working on a web framework as well based on wasm in the browser. It's perfect except it's not really usuable/production ready due to high memory consumption of the go->wasm implementation. My hope is that one day there will be support for GC in wasm and somehow the issue will go away.
- cube2222 4y agoHave you looked into using TinyGo[0]? It's a Go-for-embedded compiler and can compile Go to WASM as well. It's supposed to result in much smaller artifacts. [0]: https://tinygo.org/docs/guides/webassembly/ https://tinygo.org/docs/guides/webassembly/
- TobyTheDog123 4y agoIn my experience, TinyGo is far from ready for prime time, mainly because of its lack of support for JSON marshaling/unmarshaling. I run Go code in Cloudflare Workers, and just use the regular-ol' WASM targets (GOOS=js/GOARCH=wasm)
- oefrha 4y agoHuh, CF Workers used to limit the payload to 1MB, and any slightly nontrivial golang js/wasm artifact (not tinygo) I’ve ever built was >2MB compressed, so the idea of running those on CF Workers was dead on arrival. However, apparently the limit was raised to 5MB for paid plans some time last year.
- thefounder 4y agoI'm using a lot of reflection and I believe tinygo has had some issues with the reflect package. I'm not really ready to dig into Tinygo issues. I've spent a lot of time dealing with Go's own reflect issue(i.e [0]) in its default implementation. https://github.com/golang/go/issues/15924 https://github.com/golang/go/issues/15924
- 4y ago
- denysvitali 4y agoSo basically PHP, but in Go? I love Go, but I honestly hope this doesn't become as widespread as PHP. There is a reason why we switched away from template-based frontends (à la PHP). On the other side, it's also true that some frontend frameworks are partially moving back to SSR...
- shadowgovt 4y agoOne counterpoint is React is doing gangbusters right now and uses the JSX syntax extension to embed HTML directly into JavaScript or TypeScript. To my money, the main issues with PHP had little to do with template embedding and everything to do with Perl being a messy language for writing correct code (coupled with too many people in the era underestimating the importance of "correctness" for HTML rendering when the ability for a malicious operator to mutate HTML on a page can result in all manner of security exploits). Perl just has too many ways to write accepted almost-correct code that breaks abstraction / fails to string-escape in subtle and whole-farm-losing ways.
- kennywinker 4y agoAre you equating PHP and Perl? If so, that's incorrect - the relationship between the two is just one of influence, PHP has some influences from Perl (but also tons from C, C++, and Java).
- shadowgovt 4y agoTo be fair, you haven't exactly augmented the single-element list [Perl] with a host of languages that I'd consider improvements on writing correct code. ;) Java, yes, mostly.
- hiccuphippo 4y agoThere's a difference though. JSX embeds html into strings while the way Php intermingles html and code uses global buffers. That makes composition more complicated since you have to deal with nested buffers, flushing, cleaning, etc. I really prefer the way JSX does it over Php's.
- whage 4y agoThis really seems like php. I also think that mixing UI with logic is a recipe for disaster and there is already php (and several others?) for that. I suppose the creators of such a thing have a decent knowledge of compilers and related domains, knowledge which really seems wasted on a project like this.
- deleted 4y ago[deleted]
- shadowgovt 4y agoThis looks neat. Always be wary of this on a new web framework: > Pushup is an experiment. In terms of the development life cycle, it should be considered preview pre-release software The biggest risk with such software as a web framework is security exploits. The nuances of the HTML escaping dance are subtle and hard to get right. (Not to say this gets them wrong or can't get them right, only that all such code should be assumed-risky for security until proven otherwise).
- TobyTheDog123 4y agoThis looks great for simple projects, but I'm curious who is working on projects small enough to not be worth a separate dedicated and feature-filled frontend (ala JS/Flutter), but large enough to warrant server-side logic. That's certainly not to say they don't exist, and Pushup is certainly filling a niche, but my mind immediately goes to those "forgotten" services like email unsubscription and confirmation links.
- paulsmith 4y agoYep, or admins or settings apps, for example. Pushup is partly designed to support the "mildly dynamic" site https://www.devever.net/~hl/mildlydynamic https://www.devever.net/~hl/mildlydynamic
- IceWreck 4y agoThese programmers were so preoccupied with whether or not they could, they didn’t stop to think if they should. That abomination of a markup cum programming langauge is so ugly. Seriously tho, cool project but ugly syntax.
- paulsmith 4y agoDo you think all template languages that combine logic and markup are ugly? Or just Pushup's?
- robertlagrant 4y agoI like that Flask has Jinja2, which has a simple template language in it, but doesn't let you run arbitrary Python.
- TobyTheDog123 4y agoThere's an interesting conversation to be had about developer ergonomics. For me, on a Mac, it's far more easier to use characters and symbols on the bottom of the keyboard. <script></script>. It's even easy to use a select few symbols from the number row. !, @, #, $ uses my left pinky on the left shift, left hand middle (or index) finger on the number &, *, (, and ) use my left pinky on the left shift, right hand finger on the number. ^ (and % + & to an extent) seem to be a no-mans land, similar to smart phone screens only allowing limited easy reach. If you're going to be typing a symbol character to mark a variable (or whatever else) it certainly needs to be easy to reach, and for me at least, the ^ isn't. Maybe it's just my typing style or that I have small fingers :( Edit: Also, what about IDE plugins? I would hate to lose type safety or smart suggestions for a line like this: <p>The time is now ^time.Now().String().</p>
- kroltan 4y agoAlso, some keyboard layouts use dead keys for inputting ^ as a diacritic (for example, ABNT2 Portuguese, the standard in Brazil). This means that to type "â" I press the ^ key, which is actually Shift+~, then I press the letter to go under it, in this case, "a". If I want to type a standalone ^, I have to either press Shift+~ twice, or follow the Shift+~ with an invalid letter, such as "q" or space. So typing a lot of code that uses ^ is very annoying. For example, to type "^section" you have to do: Shift+~, Space, S... Additionally, and this is purely Apple's fault for being entirely deranged, on Macs you have to watch out even further, as it is possible to write both ^ and ˆ, depending on what you press. Shift+~ then space prints the lone diacritic, while Shift+~ then right arrow prints the ASCII ^ you've seen so far. Obviously, having to reach for the arrow keys for a common occurrence when typing is incredibly inconvenient, on top of the inconvenience described previously.
- paulsmith 4y ago> Also, what about IDE plugins? An LSP server for Pushup syntax is on the informal roadmap.
- nprateem 4y agoTBH all I want are Django's generic views implemented in Go to make it easy to map routes to DB resources to speed up making APIs. Ideally it would automagically expose a whitelisted list of DB tables as API endpoints but allow the ability to override queries for each table and perform logic as necessary (i.e. support custom handlers as well as lightweight default ones). If anyone knows of anything like that please let me know.
- Xeoncross 4y agosqlc.dev plus gongular and you have a quick REST api sqlc.dev plus gql-gen and you have a quick GraphQL server sqlc.dev plus goa.design and you have a full-featured REST + gRPC server with OpenAPI for easy client generation No need to write model code and validation for inputs/outputs. Just define your SQL queries and your request objects (or typedefs for GraphQL) and then let these tools generate everything else.
- lprd 4y agoYou've piqued my interest. Do you know of any OSS repos that implement any of these?
- Xeoncross 4y agoNo, I'd really like to see this change as I feel there are a lot of hidden gems in the Go ecosystem. Developers arrive in Go, find Gin and start making their Rails/Laravel/Express.js MVC framework without realizing Go offers some alternatives by it's design (Rust too!)
- jakelazaroff 4y agoThis looks really promising — at first blush, I like this a lot more than normal Go templating! That said: maybe it's just my bias as someone who primarily works with React, but I'm wondering why not just mimic JSX, which has been incredibly successful and has millions of people who already understand it. The big missing piece to me here is composability. How can I encapsulate reusable bits of markup, styles and presentational logic? In most JS frameworks, I'd extract them into a "component" (in React, that just means a function that returns JSX). Pushup has "partials," but it's not clear to me whether they're reusable or if that word means something different in Pushup than it does in other templating systems. I see that layouts can denote sections to be filled in by pages, but IMO that's backwards — a page now needs to know details about its "call site". Using ^ as a delimiter seems odd, but I suppose that's just a familiarity thing. I do wonder though how you handle your example of <p>The time is now ^time.Now().String().</p> without having to backtrack, since that last period is ambiguous in this grammar.
- paulsmith 4y ago> why not just mimic JSX Definitely considered that. Might be worth revisiting. > The big missing piece to me here is composability You zeroed in on the right things ;^) I have a draft note to myself about pages-as-components. I have some ideas (basically, mimic ASP.net Razor components at the moment). Having a compiler with full control of the page makes this easier to figure out. > without having to backtrack, since that last period is ambiguous in this grammar. It doesn't backtrack, it just looksahead at the next token: https://github.com/adhocteam/pushup/blob/main/main.go#L3692 https://github.com/adhocteam/pushup/blob/main/main.go#L3692
- HALtheWise 4y agoI actually hacked together "JSX in go" over a few weeks a couple years ago, targeting wasm/GopherJS so the code could actually execute in the frontend. It was a really fun exercise in reading/understanding the internals of the go compiler. https://github.com/8byt/gox https://github.com/8byt/gox
- paulsmith 4y ago
- Gys 4y agoVery interesting! Kind of react, but in Go. Fingers crossed for 'Pushup Native' for mobile ;-)
- fredrikholm 4y agoBravo! This makes me genuinely happy. A sane, compiled template language for Go, integrated with a framework that pushes for HATEOAS via HTMX hits every row and column in my dream-webs-tack-bingo-card. Looking forward to digging into this during the weekend.
- Eun 4y agoNice seeing going this forward. I built something similar in the past, that can be used as a base for such framework utilizing yaegi (from the creators of traefik): https://github.com/Eun/yaegi-template https://github.com/Eun/yaegi-template
- newusertoday 4y agowell that is interesting. Is there a way to use different delimiter instead of "<$" .
- Eun 4y agoYes, you can just specify different start- and endrunes: https://github.com/Eun/yaegi-template/blob/master/template.go#L113 https://github.com/Eun/yaegi-template/blob/master/template.g...
- techn00 4y agoCopying React's JSX would be sooo cool (like Rust's https://dioxuslabs.com/ https://dioxuslabs.com/ ), or something like phoenix liveview for elixir. I don't like the "^"
- eddwinpaz 4y agoSome PHP fan trying to bring their deception to go.
- synergy20 4y agoI like this project to succeed but I can hardly like the ^ for template, please make it similar to PHP|django etc if possible.
- dakiol 4y agoAs others have commented, just go for <?go ... ?> instead of the caret. You'll get thousands of users in an instant.
- andreygrehov 4y agoWhen it comes to traditional web frameworks, the most important part is handling regular HTML forms. Reason being, a form is the only native mechanism your customers have to use to interact with your service. Forms are important. Specifically, validation and error handling. I think Laravel does it really well. It's been a while, but Laravel has a wrapper around HTML forms. This wrapper does everything you need: server-side form validation, form generation, flexible error handling that takes care of client error messages, placeholders, input values, css classes for invalid states, you name it. Does Pushup help engineers with HTML forms?
- miohtama 4y agoThis plus CRUD pattern - after the submission you want to edit the data usually with a slightly different form.
- randomguy0 4y agoAny more info on this form wrapper for Laravel?
- andreygrehov 4y agoThis is how it used to be - https://laravel.com/docs/4.2/html https://laravel.com/docs/4.2/html I haven't used Laravel for many years. I couldn't find the equivalent functionality in the latest version of the framework, which is 9.x, but pretty sure they should have something similar.
- AlbinoDrought 4y agoHere's the latest equivalent of those docs: https://laravel.com/docs/9.x/blade#forms https://laravel.com/docs/9.x/blade#forms
- chx 4y agoRegular HTML forms are hard. Source: I was the Drupal form API maintainer for a long time. Way too long.
- 4y ago
- euroderf 4y agoLooks cool! Two questions: What does a Treeview look like - in a ".up" file, can I walk a tree (like io.fs.FS) ? Can I compile a Pushup app into a giant WASM hairball and run the whole thing in the browser ?
- paulsmith 4y ago> What does a Treeview look like - in a ".up" file, can I walk a tree (like io.fs.FS) ? Yes, you can just write normal Go code to traverse a filesystem and do with it whatever you like. > Can I compile a Pushup app into a giant WASM hairball and run the whole thing in the browser ? I haven't tried this so I don't know what would happen, and a lot would depend on what kind of JS host runtime support there was for anything that is doing a syscall. But related to WASM, an idea I have is to add syntax to be able to split a Pushup page into client-side and server-side code, compile the client-side code to WASM, and use the Pushup compiler to generate the appropriate handoffs for any network calls between (AJAX, websocket, etc.)
- euroderf 4y agoIdeally then, the client side could run in disconnected mode. But then you encounter DB sync issues. And I wonder what htmx does then.
- imranhou 4y agoHow do I debug apps built with this compared to dev tools with plain js?
- no_wizard 4y agoWhy a new template syntax? What wrong with the standard go templates?
- nprateem 4y agoIs there a decent auth library for go similar to what django provides, or do people just use keycloak for user accounts?
- whalesalad 4y agoPHP and Golang have had a child. At last, a modern rope to hang yourself with.
- euroderf 4y agoOK so who's gonna integrate this with pocketbase and maybe datasette too ? Set a standard, maybe.
- smoyer 4y agoThis is really cool - so cool that I hate to be a naysayer. We used to build pages this way and to a large degree moved away from this practice because the applications became to hard to test. At the other end of the spectrum is "Passive View" which allows for testing of the business logic and easy mocking of the view - https://martinfowler.com/eaaDev/PassiveScreen.html https://martinfowler.com/eaaDev/PassiveScreen.html.