8 ms·

Crate.io: A new kind of Python package index

132 points by ak217 13y ago

rpicard 13y ago
This looks pretty nice. It would look better if you moved away from the default Bootstrap look. You don't really say what it is, but I'm assuming it's just a front end for information from PyPI.
- niwibe 13y ago
  Is a mirror of PyPI. Is not only frontend, is a separate service.
- ak217 13y ago
  I'm not the author, but to me this is an attempt to reinvent PyPI from the ground up, with a focus on usability.
- joshbaptiste 13y ago
  I don't care about the look, bootstrap whatever.. it works i'm fine.. great work.
  - lovamova 13y ago
    Wait until Bootstrap gets in the way…
- Myrmornis 13y ago
  If it "looks pretty nice" then that's more than enough -- the author is no doubt trying to solve an actual problem, not just pander to the aesthetic whims of "design" types.
  - rpicard 13y ago
    I thought the point was to make PyPI look nicer. I still don't understand what problem they're solving.
defrex 13y ago
"Crate is a new kind of Python package index." Why?
valtron 13y ago
Great commit message: https://github.com/crateio/crate.pypi/commit/94ce379fe386c9051fbe21a6dd992ec9d6b8db87 https://github.com/crateio/crate.pypi/commit/94ce379fe386c90...
- donaldstufft 13y ago
  Working with PyPI tends to make for an angry time.
Fomite 13y ago
Yes, but what does it do?
kespindler 13y ago
yeah i like this too. very nice! and would much prefer looking at and using this to pypi. although i will say i usually just google for a python package and come across a stackexchange that points me to some package, rather than using some index. if you can become some authoritative reference, more power to you.
kespindler 13y ago
yeah i like this too. very nice! and would much prefer looking at and using this to pypi. although i will say i usually just google for a python package and come across a stackexchange that points me to some package, rather than using some index. if you can become some authoritative reference, more power to you.
daemonfire300 13y ago
Lacking an "about" section is even bad if your product is self-explanatory. Why do we need another Package Index? The purpose of an index is centralizing things. Why would we need crate? Is this just an attempt of Heroku PR? Or isn't heroku behind this? I am quite confused, and kindly negative attituded to this project.
calpaterson 13y ago
This is pretty great. A substantial improvement on PyPI. I like the link to ReadTheDocs - something which I often have to hunt for on PyPI
pessimism 13y ago
I get a 500, when I try to sign up using GitHub. Happens at https://crate.io/social-auth/complete/github/?code=123
sachingulaya 13y ago
Am I nuts or was crate.io a paid filedrop service in the past?
- chrishenn 13y ago
  You are thinking of https://letscrate.com/ https://letscrate.com/.
mkumm 13y ago
Nice and clean but I am not sure what problem it is really trying to solve.
- sdfjkl 13y ago
  Have you tried using the Cheeseshop lately? I have. It was a painfully slow and wretched experience and I ended up browsing multiple pages to find what I was looking for.
ollieglass 13y ago
Nice. I'd like to sort search results by the number of downloads.
flexd 13y ago
I am confused as to exactly what Crate.io does differently to PyPi. Yes, it is a better web interface, but what are the actual improvements over PyPi? Why would we use it? Wouldn't it be better for the PyPi website to get a revamp? As it is now the front page of PyPi https://pypi.python.org/pypi https://pypi.python.org/pypi gives us more information than the front page of Crate. I like that it's quick, PyPi is a bit slow for me at the moment. I also like the info page for a specific package (https://crate.io/packages/docopt/#description https://crate.io/packages/docopt/#description), it's nice and informative, quite easy to read but I do not like that you have to click the info tab to see the classifiers (which python versions it works with, among other things). What is the key arguments and features that should make us want to use Crate.io over PyPi? I mostly interface with PyPi via pip on the commandline. Is crate supposed to be a drop-in replacement? Can we just make pip work against a different base url? Will you launch your own pip replacement? How is Crate.io better than the current PyPi? The website does not mention any of this, it barely contains any text. </ramble>, I've just wrote up a few of the questions I had while checking it out, sorry if it's a bit incoherent :-)
- _wmd 13y ago
  It implements full text search without repeated strcmp() over half a gigabyte of strings, so search completes in reasonable time. Compare that to PyPi which does exactly what I described, and even during off peak periods, searches can sometimes take up to 20 seconds
  - srinidhiv 13y ago
    Why not just fork the pypi code and fix it, then?
    - donaldstufft 13y ago
      Have you looked at the PyPI codebase? ;) The real answer is I have. I'm a PyPI administrator now and have been enacting a lot of these benefits on PyPI itself. Just this weekend I've deployed a CDN in front of all of PyPI so that package downloads have sped up by 1-3 orders of magnitude depending on location. Previously I had pushed hard for getting a real valid and trusted SSL certificate on PyPI, moving the user provided html/js from packages.python.org to pythonhosted.org in order to prevent CSRF fixation attacks. Like I said Crate is an experiment. One that has enabled me to push for good changes in PyPI.
lifeisstillgood 13y ago
Maybe I am being dumb but I don't really get it Pypi.python.org/simple is the heart of everything - do we even use a package repository to browse for packages these days - or do we rely on the blue googles?
mihok 13y ago
How does it pick up the packages? Is there a registration to get on board? I have some PyPi packages that aren't showing up in search, how would I go about adding said packages to this index?
- donaldstufft 13y ago
  It uses the XMLRPC API to pick up new packages. http://wiki.python.org/moin/PyPIXmlRpc http://wiki.python.org/moin/PyPIXmlRpc
Siecje 13y ago
Where does the downloads information come from?
jgalt212 13y ago
I would find either PyPi or Crate.io more useful if either of them provided a method to determine which modules are downloaded most often.
- seubert 13y ago
  http://mail.python.org/pipermail/distutils-sig/2013-May/020855.html http://mail.python.org/pipermail/distutils-sig/2013-May/0208...
monkmartinez 13y ago
Would love to see PyPI or Crate.io list dependencies or provide a way to view them before I download a package...
- JulianWasTaken 13y ago
  Unfortunately in the general case that's not information PyPI will know.
  - donaldstufft 13y ago
    Not yet anyways ;)
ylem 13y ago
What adding about some ability to browse? It is fast!
reidrac 13y ago
Looks great! I miss one thing: PGP signature files. I've been checking one of my packages and PyPI is showing the .asc file but crate only shows the sha256 hash.

132 points by ak217 13y ago

This looks pretty nice. It would look better if you moved away from the default Bootstrap look. You don't really say what it is, but I'm assuming it's just a front end for information from PyPI.

niwibe 13y ago
Is a mirror of PyPI. Is not only frontend, is a separate service.
ak217 13y ago
I'm not the author, but to me this is an attempt to reinvent PyPI from the ground up, with a focus on usability.
joshbaptiste 13y ago
I don't care about the look, bootstrap whatever.. it works i'm fine.. great work.
- lovamova 13y ago
  Wait until Bootstrap gets in the way…
Myrmornis 13y ago
If it "looks pretty nice" then that's more than enough -- the author is no doubt trying to solve an actual problem, not just pander to the aesthetic whims of "design" types.
- rpicard 13y ago
  I thought the point was to make PyPI look nicer. I still don't understand what problem they're solving.

defrex 13y ago

"Crate is a new kind of Python package index." Why?

valtron 13y ago

Great commit message: https://github.com/crateio/crate.pypi/commit/94ce379fe386c9051fbe21a6dd992ec9d6b8db87 https://github.com/crateio/crate.pypi/commit/94ce379fe386c90...

donaldstufft 13y ago
Working with PyPI tends to make for an angry time.

Fomite 13y ago

Yes, but what does it do?

kespindler 13y ago

yeah i like this too. very nice! and would much prefer looking at and using this to pypi. although i will say i usually just google for a python package and come across a stackexchange that points me to some package, rather than using some index. if you can become some authoritative reference, more power to you.

kespindler 13y ago

daemonfire300 13y ago

Lacking an "about" section is even bad if your product is self-explanatory. Why do we need another Package Index? The purpose of an index is centralizing things. Why would we need crate? Is this just an attempt of Heroku PR? Or isn't heroku behind this? I am quite confused, and kindly negative attituded to this project.

calpaterson 13y ago

This is pretty great. A substantial improvement on PyPI. I like the link to ReadTheDocs - something which I often have to hunt for on PyPI

pessimism 13y ago

I get a 500, when I try to sign up using GitHub. Happens at https://crate.io/social-auth/complete/github/?code=123

sachingulaya 13y ago

Am I nuts or was crate.io a paid filedrop service in the past?

chrishenn 13y ago
You are thinking of https://letscrate.com/ https://letscrate.com/.

mkumm 13y ago

Nice and clean but I am not sure what problem it is really trying to solve.

sdfjkl 13y ago
Have you tried using the Cheeseshop lately? I have. It was a painfully slow and wretched experience and I ended up browsing multiple pages to find what I was looking for.

ollieglass 13y ago

Nice. I'd like to sort search results by the number of downloads.

flexd 13y ago

I am confused as to exactly what Crate.io does differently to PyPi. Yes, it is a better web interface, but what are the actual improvements over PyPi? Why would we use it? Wouldn't it be better for the PyPi website to get a revamp? As it is now the front page of PyPi https://pypi.python.org/pypi https://pypi.python.org/pypi gives us more information than the front page of Crate. I like that it's quick, PyPi is a bit slow for me at the moment. I also like the info page for a specific package (https://crate.io/packages/docopt/#description https://crate.io/packages/docopt/#description), it's nice and informative, quite easy to read but I do not like that you have to click the info tab to see the classifiers (which python versions it works with, among other things). What is the key arguments and features that should make us want to use Crate.io over PyPi? I mostly interface with PyPi via pip on the commandline. Is crate supposed to be a drop-in replacement? Can we just make pip work against a different base url? Will you launch your own pip replacement? How is Crate.io better than the current PyPi? The website does not mention any of this, it barely contains any text. </ramble>, I've just wrote up a few of the questions I had while checking it out, sorry if it's a bit incoherent :-)

_wmd 13y ago
It implements full text search without repeated strcmp() over half a gigabyte of strings, so search completes in reasonable time. Compare that to PyPi which does exactly what I described, and even during off peak periods, searches can sometimes take up to 20 seconds
- srinidhiv 13y ago
  Why not just fork the pypi code and fix it, then?
  - donaldstufft 13y ago
    Have you looked at the PyPI codebase? ;) The real answer is I have. I'm a PyPI administrator now and have been enacting a lot of these benefits on PyPI itself. Just this weekend I've deployed a CDN in front of all of PyPI so that package downloads have sped up by 1-3 orders of magnitude depending on location. Previously I had pushed hard for getting a real valid and trusted SSL certificate on PyPI, moving the user provided html/js from packages.python.org to pythonhosted.org in order to prevent CSRF fixation attacks. Like I said Crate is an experiment. One that has enabled me to push for good changes in PyPI.

lifeisstillgood 13y ago

Maybe I am being dumb but I don't really get it Pypi.python.org/simple is the heart of everything - do we even use a package repository to browse for packages these days - or do we rely on the blue googles?

mihok 13y ago

How does it pick up the packages? Is there a registration to get on board? I have some PyPi packages that aren't showing up in search, how would I go about adding said packages to this index?

donaldstufft 13y ago
It uses the XMLRPC API to pick up new packages. http://wiki.python.org/moin/PyPIXmlRpc http://wiki.python.org/moin/PyPIXmlRpc

Siecje 13y ago

Where does the downloads information come from?

jgalt212 13y ago

I would find either PyPi or Crate.io more useful if either of them provided a method to determine which modules are downloaded most often.

seubert 13y ago
http://mail.python.org/pipermail/distutils-sig/2013-May/020855.html http://mail.python.org/pipermail/distutils-sig/2013-May/0208...

monkmartinez 13y ago

Would love to see PyPI or Crate.io list dependencies or provide a way to view them before I download a package...

JulianWasTaken 13y ago
Unfortunately in the general case that's not information PyPI will know.
- donaldstufft 13y ago
  Not yet anyways ;)

ylem 13y ago

What adding about some ability to browse? It is fast!

reidrac 13y ago

Looks great! I miss one thing: PGP signature files. I've been checking one of my packages and PyPI is showing the .asc file but crate only shows the sha256 hash.