tikazyq

6 ms·

1.
LeanSpec: High Dev Velocity from Spec Coding(marvinzhang.dev)
2 points by tikazyq 10mo ago|0 comments
2.
Show HN: LeanSpec - Built in 10 days using the specs it defines(github.com)
2 points by tikazyq 11mo ago|0 comments
3.
This GitHub Repository Qualifies for a Guinness World Record(github.com)
2 points by tikazyq 1y ago|1 comments
4.
by tikazyq 1y ago
We recently came across something truly astonishing on GitHub: a single repository holding over 200,000 Git tags. This immense number is so extraordinary that we honestly believe it qualifies for a Guinness World Record. Interestingly, tryi
5.
Crawlab AI: The Next Frontier in Automated, Code-Free Data Scraping(ai.crawlab.io)
3 points by tikazyq 3y ago|1 comments
6.
by tikazyq 3y ago
Meet Crawlab AI Playground: a pioneering platform transforming the way we think about web scraping. With its intuitive AI-powered interface, Crawlab AI makes it possible to extract web data seamlessly—no coding required. Just input your URL
7.
Unleash Your Reading Potential: Embark on a New Intelligent Reading Experience(sread.ai)
2 points by tikazyq 3y ago|0 comments
8.
SRead Chrome Extension Released(medium.com)
3 points by tikazyq 3y ago|0 comments
9.
How to Get Structured Data Using OpenAI Function Call API in LangChain(medium.com)
1 points by tikazyq 3y ago|0 comments
10.
An AI-Powered Smart Reading Assistant for Webpages/PDFs/Word/PPT/etc.(sread.ai)
1 points by tikazyq 3y ago|0 comments
11.
Building an Efficient Knowledge Question-Answering System with LangChain(medium.com)
3 points by tikazyq 3y ago|0 comments
12.
Exploration of Intelligent Web Crawlers(medium.com)
3 points by tikazyq 4y ago|0 comments
13.
Automatic Web Content Detection(github.com)
3 points by tikazyq 4y ago|0 comments
14.
A Crawler Admin GitHub Project Reaching 5k Stars in 1 Year(github.com)
1 points by tikazyq 6y ago|0 comments
15.
Web Crawler Admin Platform Crawlab v0.4.8 Release(medium.com)
1 points by tikazyq 7y ago|0 comments
16.
Web Crawler Admin Platform Crawlab v0.4.7 Release(medium.com)
1 points by tikazyq 7y ago|0 comments
17.
Web Crawler Admin Platform Crawlab v0.4.6 Release(crawlab.cn)
3 points by tikazyq 7y ago|0 comments
18.
How to develop a web crawler in 90 seconds(medium.com)
5 points by tikazyq 7y ago|0 comments
19.
Distributed Web Crawler Management Platform(github.com)
7 points by tikazyq 7y ago|0 comments
20.
by tikazyq 7y ago
Thanks all for the upvoting and positive feedbacks for Crawlab. The reason why Crawlab is mainly focused on Chinese is because it was initially promoted in mainland China tech sites (Juejin, V2ex, etc). Due to the GFW we cannot access the i
21.
by tikazyq 7y ago
There are a couple of crawler management projects: scrapydweb, spiderkeeper, gerapy, crawlab. The first three are based on scrapyd.
22.
by tikazyq 7y ago
Crawlab is based on shell execution, so basically anything that is runnable in shell, it can be run on Crawlab, i.e. any language.
23.
by tikazyq 7y ago
No, we are using SubPub for message communication between nodes. For tasks, we are using hashed list. English documentation missing but we will add it later.
24.
by tikazyq 7y ago
Thanks @atymic for the feedback. The initial password for admin is changed so that no harmful action would be done on the demo. Instead, you can still sign-up to checkout the demo. And we do have an English version but not on the Login page
25.
by tikazyq 7y ago
Thanks for the feedback. Actually I saw a lot of great Chinese projects on Github trending and sadly they are Chinese only. I would definitely agree they can do better by translating into English!
26.
by tikazyq 7y ago
Hi, Thanks for the upvotes. Crawlab is a golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium
27.
Show HN: Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language(github.com)
116 points by tikazyq 7y ago|18 comments
28.
Crawlab: Crawler Admin Platform Managing Any Web Crawler(github.com)
2 points by tikazyq 7y ago|0 comments