6 ms·

I quickly looked this over. Does Golang have some hidden ORM like feature that makes complex persistence easy? I spent the last three months working on a storag

I quickly looked this over. Does Golang have some hidden ORM like feature that makes complex persistence easy? I spent the last three months working on a storage mechanism that controls all of CRUD at the document level across what is essentially Google Groups (each op is allowed to multiple groups). This is where web work is complex.

kornish 9y ago
> Does Golang have some hidden ... feature No.
- yehohanan7 9y ago
  haha
bsaul 9y ago
Came here to say the same thing. Go won't enter "crud webapp" market until they have a better story on relational db interactions. I'm afraid this is way beyond the current possibilities of the language as it offer barely any meta-programming technics, on purpose.
- kaio 9y ago
  Did you had a look at sqlx? [1] Granted, it won't generate the queries for you - but parsing into structs works 95% of time without additional mapping for me. Coming from other languages I also found the amount of necessary typing a bit disturbing first. But then you can actually read code instead of orm framework documentation, issue trackers and workarounds. [1] http://jmoiron.github.io/sqlx/ http://jmoiron.github.io/sqlx/
  - bsaul 9y ago
    sqlx didn't work in my case last time i tried (don't remember why exactly), but it's still far from any standard like sqlalchemy (python), hibernate (java) , active records (ruby),entity framework (.net), doctrine (php) or bookshelf (js). Writing every select for every entity, with all the variations depending on whether you want to inner join with 1-n relationships (and which ones) is really tedious when you've got 30 entities in your model.
    - weberc2 9y ago
      We use SQLalchemy at work and I would rather write queries by hand. A lot of that is because the documentation is a huge pain, but also because the object composition isn't intuitive. I've built a profile query builder in Go and it was pretty straight forward; I'm confident I could build an ORM in a couple of weeks.
      - bsaul 9y ago
        sqlalchemy ( which i used and liked a lot) has multiple layers. query builder is the bottom one, but the most "challenging" one for go is probably the orm with things lazy loading and its parametrization ( such as eager loading of relationships). keeping it all type safe ( not having the user cast interface{} to struct everywhere) and performant would be a challenge.
        weberc2 9y ago
        I'm not sure exactly what you mean about parameterization, but I suspect in general my notion of what an ORM is differs from yours (in particular, I don't assume lazy loading). Maybe what I'm thinking isn't appropriately called "ORM" (maybe "type relational mapping" is more appropriate?). At any rate, I don't think type safety should be a challenge (somehow a mapping must be generated for each type, just like SQLAlchemy--in Go this can be either explicit or inferred once via reflection or code generation) and I don't think performance would be more a challenge in Go than any other language (the trick to ORM performance is in building efficient SQL queries, not in reflection or type asserts).
        bsaul 9y ago
        compile-time code generation can only get you so far, unless you're ready to generate every single kind of query beforehand ( which grows exponentially with the number of -to-many relationship). You'll have to rely on introspection but i suspect things won't go smoothly. anyway, it should make for a good exercise i'm sure. as for the definition of Object-Relationnal-Mapper the idea is to completely abstract the fact that you're storing your object graph ( or struct graph in the case of go) in a relationnal database. To do so, the developper provides meta data , like an xml file or annotation, to describe the mapping. This is a pretty hard problem.
- simplehuman 9y ago
  What about https://github.com/go-xorm/xorm https://github.com/go-xorm/xorm ?
  - bsaul 9y ago
    Thanks for the link, i didn't know about it. From what i see from the documentation (which looks pretty sparse) it doesn't implement lazy loading or any kind of mapping between SQL relation (1-n , n-n) to and from the go structs, so i guess it's pretty far from any of today's standard.
    - ptman 9y ago
      I've used https://github.com/jinzhu/gorm https://github.com/jinzhu/gorm with Go, and it's ok. Sometimes I just use https://github.com/Masterminds/squirrel https://github.com/Masterminds/squirrel or https://github.com/elgris/sqrl https://github.com/elgris/sqrl with database/sql or https://github.com/jmoiron/sqlx https://github.com/jmoiron/sqlx
- peterkieltyka 9y ago
  check out https://github.com/upper/db https://github.com/upper/db as well while you evaluate the various projects
- Thaxll 9y ago
  None of the company I worked for had any ORM like in place and they were all doing crud app.
  - bsaul 9y ago
    i've seen companies forbid the use of ORMs by fear that developpers will abuse lazy loading and collapse the db instead of using inner joins ( which any decent orm is able to do btw). It could make sense in some context, and i'm pretty sure that any sufficiently advanced service has so many custom and optimized queries that an ORM doesn't make a difference. however IMHO, ORMs do play a very important role in the beginning of the project when prototyping screens and apis, and when rapid iteration is important. It isn't a coincidence that RoR advertized active record as much, that symfony use doctrine in all tutorials, and that java , .net and node.js frameworks all include an ORM component.
jalfresi 9y ago
There is no ORM like feature anywhere that makes complex persistence easy.
- jalfresi 9y ago
  Sorry if that was a snarky reply. I have a deep hatred of ORMs. In the past I've had great success with XO, which will generate Go code from an existing DB Schema: https://github.com/knq/xo https://github.com/knq/xo It's really very good!
Cthulhu_ 9y ago
I'm no expert, but I think for ORM like you're referring to, the language would need features like generics, which Go doesn't have and may never have. At best there would be a code generator which would allow you to write your stuff in a higher-level language which would generate compilable and efficient Go code in turn.
- charlesetc 9y ago
  Code generation is one way to get around generics. Go also stores all the type data at runtime so you can inspect the arguments passed to any function, which gives the same kind of generic behavior in any dynamically typed language. So you definitely could implement an ORM in go without code generation - it's almost certainly been done.
swah 9y ago
I'm learning Django after playing with Go and webapps just to see how much easier can some things be...
- ddorian43 9y ago
  Are they easier on django compared to go+framework ?
  - ruleabidinguser 9y ago
    Djangos ORM is really really good. Plus it's integration with RabbitMQ through Celery, and so on. Django is kind of the golden standard of web frameworks. (Not having tried rails)
  - swah 9y ago
    Golang is quite strict about unused variables and imports (the last one is fixed by an external tool). This IMO makes it a little bit rigid for prototyping web apps.
ahacker15 9y ago
Take a look at Gorm: http://jinzhu.me/gorm/ http://jinzhu.me/gorm/
deleted 9y ago
[deleted]
heavenlyhash 9y ago
I've been experimenting with a library called `refmt` which does the Object Mapping part, but explicitly not the Relational part. It's still experimental, but you might like it, and test coverage is shaping up nicely. The idea is by focusing completely on making Object Mapping consistent and powerfully customizable, and then composing that with either serialization formats or relational storage, we'll get good things. Right now we seem to be at and awkward hump of complexity where every new DB binding ends up implementing their own object mapping, increasing everyone's complexity, overhead, and decreasing reusability of code; refmt will hopefully represent a break from that. https://github.com/polydawn/refmt https://github.com/polydawn/refmt
- jdc0589 9y ago
  object mapping is the most important part of the ORM experience in my opinion. Writing DB queries isn't hard or even annoying, manually doing model binding constantly is frickin infuriating.

kornish 9y ago

> Does Golang have some hidden ... feature No.

yehohanan7 9y ago
haha

bsaul 9y ago

Came here to say the same thing. Go won't enter "crud webapp" market until they have a better story on relational db interactions. I'm afraid this is way beyond the current possibilities of the language as it offer barely any meta-programming technics, on purpose.

kaio 9y ago
Did you had a look at sqlx? [1] Granted, it won't generate the queries for you - but parsing into structs works 95% of time without additional mapping for me. Coming from other languages I also found the amount of necessary typing a bit disturbing first. But then you can actually read code instead of orm framework documentation, issue trackers and workarounds. [1] http://jmoiron.github.io/sqlx/ http://jmoiron.github.io/sqlx/
- bsaul 9y ago
  sqlx didn't work in my case last time i tried (don't remember why exactly), but it's still far from any standard like sqlalchemy (python), hibernate (java) , active records (ruby),entity framework (.net), doctrine (php) or bookshelf (js). Writing every select for every entity, with all the variations depending on whether you want to inner join with 1-n relationships (and which ones) is really tedious when you've got 30 entities in your model.
  - weberc2 9y ago
    We use SQLalchemy at work and I would rather write queries by hand. A lot of that is because the documentation is a huge pain, but also because the object composition isn't intuitive. I've built a profile query builder in Go and it was pretty straight forward; I'm confident I could build an ORM in a couple of weeks.
    - bsaul 9y ago
      sqlalchemy ( which i used and liked a lot) has multiple layers. query builder is the bottom one, but the most "challenging" one for go is probably the orm with things lazy loading and its parametrization ( such as eager loading of relationships). keeping it all type safe ( not having the user cast interface{} to struct everywhere) and performant would be a challenge.
      - weberc2 9y ago
        I'm not sure exactly what you mean about parameterization, but I suspect in general my notion of what an ORM is differs from yours (in particular, I don't assume lazy loading). Maybe what I'm thinking isn't appropriately called "ORM" (maybe "type relational mapping" is more appropriate?). At any rate, I don't think type safety should be a challenge (somehow a mapping must be generated for each type, just like SQLAlchemy--in Go this can be either explicit or inferred once via reflection or code generation) and I don't think performance would be more a challenge in Go than any other language (the trick to ORM performance is in building efficient SQL queries, not in reflection or type asserts).
        bsaul 9y ago
        compile-time code generation can only get you so far, unless you're ready to generate every single kind of query beforehand ( which grows exponentially with the number of -to-many relationship). You'll have to rely on introspection but i suspect things won't go smoothly. anyway, it should make for a good exercise i'm sure. as for the definition of Object-Relationnal-Mapper the idea is to completely abstract the fact that you're storing your object graph ( or struct graph in the case of go) in a relationnal database. To do so, the developper provides meta data , like an xml file or annotation, to describe the mapping. This is a pretty hard problem.
simplehuman 9y ago
What about https://github.com/go-xorm/xorm https://github.com/go-xorm/xorm ?
- bsaul 9y ago
  Thanks for the link, i didn't know about it. From what i see from the documentation (which looks pretty sparse) it doesn't implement lazy loading or any kind of mapping between SQL relation (1-n , n-n) to and from the go structs, so i guess it's pretty far from any of today's standard.
  - ptman 9y ago
    I've used https://github.com/jinzhu/gorm https://github.com/jinzhu/gorm with Go, and it's ok. Sometimes I just use https://github.com/Masterminds/squirrel https://github.com/Masterminds/squirrel or https://github.com/elgris/sqrl https://github.com/elgris/sqrl with database/sql or https://github.com/jmoiron/sqlx https://github.com/jmoiron/sqlx
peterkieltyka 9y ago
check out https://github.com/upper/db https://github.com/upper/db as well while you evaluate the various projects
Thaxll 9y ago
None of the company I worked for had any ORM like in place and they were all doing crud app.
- bsaul 9y ago
  i've seen companies forbid the use of ORMs by fear that developpers will abuse lazy loading and collapse the db instead of using inner joins ( which any decent orm is able to do btw). It could make sense in some context, and i'm pretty sure that any sufficiently advanced service has so many custom and optimized queries that an ORM doesn't make a difference. however IMHO, ORMs do play a very important role in the beginning of the project when prototyping screens and apis, and when rapid iteration is important. It isn't a coincidence that RoR advertized active record as much, that symfony use doctrine in all tutorials, and that java , .net and node.js frameworks all include an ORM component.

jalfresi 9y ago

There is no ORM like feature anywhere that makes complex persistence easy.

jalfresi 9y ago
Sorry if that was a snarky reply. I have a deep hatred of ORMs. In the past I've had great success with XO, which will generate Go code from an existing DB Schema: https://github.com/knq/xo https://github.com/knq/xo It's really very good!

Cthulhu_ 9y ago

I'm no expert, but I think for ORM like you're referring to, the language would need features like generics, which Go doesn't have and may never have. At best there would be a code generator which would allow you to write your stuff in a higher-level language which would generate compilable and efficient Go code in turn.

charlesetc 9y ago
Code generation is one way to get around generics. Go also stores all the type data at runtime so you can inspect the arguments passed to any function, which gives the same kind of generic behavior in any dynamically typed language. So you definitely could implement an ORM in go without code generation - it's almost certainly been done.

swah 9y ago

I'm learning Django after playing with Go and webapps just to see how much easier can some things be...

ddorian43 9y ago
Are they easier on django compared to go+framework ?
- ruleabidinguser 9y ago
  Djangos ORM is really really good. Plus it's integration with RabbitMQ through Celery, and so on. Django is kind of the golden standard of web frameworks. (Not having tried rails)
- swah 9y ago
  Golang is quite strict about unused variables and imports (the last one is fixed by an external tool). This IMO makes it a little bit rigid for prototyping web apps.

ahacker15 9y ago

Take a look at Gorm: http://jinzhu.me/gorm/ http://jinzhu.me/gorm/

deleted 9y ago

[deleted]

heavenlyhash 9y ago

I've been experimenting with a library called `refmt` which does the Object Mapping part, but explicitly not the Relational part. It's still experimental, but you might like it, and test coverage is shaping up nicely. The idea is by focusing completely on making Object Mapping consistent and powerfully customizable, and then composing that with either serialization formats or relational storage, we'll get good things. Right now we seem to be at and awkward hump of complexity where every new DB binding ends up implementing their own object mapping, increasing everyone's complexity, overhead, and decreasing reusability of code; refmt will hopefully represent a break from that. https://github.com/polydawn/refmt https://github.com/polydawn/refmt

jdc0589 9y ago
object mapping is the most important part of the ORM experience in my opinion. Writing DB queries isn't hard or even annoying, manually doing model binding constantly is frickin infuriating.