4 ms·

> The “very long lines” exclusion is for text files that are very large but contain less than 5 or so lines. And github will block a push containing a commit w

> The “very long lines” exclusion is for text files that are very large but contain less than 5 or so lines. And github will block a push containing a commit which creates one of these files? And git itself does not?

orf 3y ago
No, if you check above: "the aim is to keep the size of the repositories within a manageable bound. This is achieved by heuristically excluding some text files that won’t compress well based on their content and size before committing." Github has a max size limit per repository. You can push a 150gb git repository to github: it won't stop you, but you'll get a message from support telling you remove it within 48 hours. By "heuristically excluding some text files that won’t compress well based on their content and size before committing", we are able to keep the size bound of the repositories within those set by Github whilst keeping the majority of useful code. We have excluded 26,610 .py files for being too large, whilst keeping 414,228,665 .py files. The average size for an excluded .py file is 15 MiB, vs ~10KiB for included files. 1. https://play.clickhouse.com/play?user=play#c2VsZWN0IHNraXBfcmVhc29uLAogICAgICAgY291bnQoKikgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGFzIHRvdGFsX2ZpbGVzLAogICAgICAgZm9ybWF0UmVhZGFibGVTaXplKHN1bShzaXplKSkgICAgICAgICAgICAgICAgICAgIGFzIHRvdGFsX3NpemUsCiAgICAgICBmb3JtYXRSZWFkYWJsZVNpemUocXVhbnRpbGUoMC45KShzaXplKSkgYXMgcDkwX3NpemUsCiAgICAgICBmb3JtYXRSZWFkYWJsZVNpemUoYXZnKHNpemUpKSBhcyBhdmVyYWdlX3NpemUKZnJvbSBweXBpCndoZXJlIGFycmF5RWxlbWVudChzcGxpdEJ5Q2hhcignLicsIGFycmF5RWxlbWVudChzcGxpdEJ5Q2hhcignLycsIHBhdGgpLCAtMSkpLCAtMSkgPSAncHknCmdyb3VwIGJ5IDEKb3JkZXIgYnkgc3VtKHNpemUpIGRlc2MKbGltaXQgMTA7Cg== https://play.clickhouse.com/play?user=play#c2VsZWN0IHNraXBfc...

4 ms·

> The “very long lines” exclusion is for text files that are very large but contain less than 5 or so lines. And github will block a push containing a commit w

by KirillPanov 3y ago

orf 3y ago
No, if you check above: "the aim is to keep the size of the repositories within a manageable bound. This is achieved by heuristically excluding some text files that won’t compress well based on their content and size before committing." Github has a max size limit per repository. You can push a 150gb git repository to github: it won't stop you, but you'll get a message from support telling you remove it within 48 hours. By "heuristically excluding some text files that won’t compress well based on their content and size before committing", we are able to keep the size bound of the repositories within those set by Github whilst keeping the majority of useful code. We have excluded 26,610 .py files for being too large, whilst keeping 414,228,665 .py files. The average size for an excluded .py file is 15 MiB, vs ~10KiB for included files. 1. https://play.clickhouse.com/play?user=play#c2VsZWN0IHNraXBfcmVhc29uLAogICAgICAgY291bnQoKikgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGFzIHRvdGFsX2ZpbGVzLAogICAgICAgZm9ybWF0UmVhZGFibGVTaXplKHN1bShzaXplKSkgICAgICAgICAgICAgICAgICAgIGFzIHRvdGFsX3NpemUsCiAgICAgICBmb3JtYXRSZWFkYWJsZVNpemUocXVhbnRpbGUoMC45KShzaXplKSkgYXMgcDkwX3NpemUsCiAgICAgICBmb3JtYXRSZWFkYWJsZVNpemUoYXZnKHNpemUpKSBhcyBhdmVyYWdlX3NpemUKZnJvbSBweXBpCndoZXJlIGFycmF5RWxlbWVudChzcGxpdEJ5Q2hhcignLicsIGFycmF5RWxlbWVudChzcGxpdEJ5Q2hhcignLycsIHBhdGgpLCAtMSkpLCAtMSkgPSAncHknCmdyb3VwIGJ5IDEKb3JkZXIgYnkgc3VtKHNpemUpIGRlc2MKbGltaXQgMTA7Cg== https://play.clickhouse.com/play?user=play#c2VsZWN0IHNraXBfc...