mtrunkat

6 ms·

1.
by mtrunkat 4y ago
Check out https://apify.com (disclaimer: I work there :)) - a platform focused on web automation and web scraping. You can easily build any (but mainly NodeJS or Python) project there as a Docker container and schedule it in a m
2.
by mtrunkat 5y ago
In our case (Apify.com) there was a complete outage of SQS (15mins+), most likely DNS problems + EC2 instances got restarted probably as a result of an SQS outage. EDIT: Also AWS Lambda seems to be down and AWS EC2 APIs having a very high e
3.
by mtrunkat 5y ago
Apify | Full-time | On-site or Remote | Prague, Czech republic Join us on our journey in building a web scraping and automation platform to help both the world’s biggest companies and upcoming startups leverage the web's full potential
4.
by mtrunkat 5y ago
Apify | Full-time | On-site or Remote | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of web automation and web scraping jobs weekly to process way over a billion web pages every month. We run on a
5.
by mtrunkat 5y ago
Apify | Full-time | On-site | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of web automation and web scraping jobs weekly to process way over a billion web pages every month. We run on a cluster o
6.
Tuning MongoDB Performance(blog.apify.com)
1 points by mtrunkat 5y ago|1 comments
7.
by mtrunkat 5y ago
This article describes some of the techniques and MongoDB Cloud features we used to debug performance issues and expose sub-optimal queries.
8.
by mtrunkat 5y ago
Apify | Full-time | On-site | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of web automation and web scraping jobs weekly to process way over a billion web pages every month. We run on a cluster o
9.
by mtrunkat 5y ago
Apify | Full-time | On-site | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of jobs weekly to process way over a billion web pages every month. We run on a cluster of Linux servers on Amazon EC2 to
10.
by mtrunkat 5y ago
Apify | Full-time | On-site | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of jobs weekly to process way over a billion web pages every month. We run on a cluster of Linux servers on Amazon EC2 to
11.
by mtrunkat 5y ago
Apify | Full-time | On-site | Prague, Czech republic Apify runs on a highly scalable infrastructure that runs millions of jobs weekly to process over a billion web pages every month . We run on a cluster of Linux servers on Amazon EC2 to pr
12.
by mtrunkat 6y ago
Apify | Full-time | On-site | Prague, Czech republic Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the Web—the largest source of information ev
13.
by mtrunkat 6y ago
Apify | Full-time | On-site/Remote | Prague | Czech republic Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the Web—the largest source of i
14.
by mtrunkat 6y ago
Apify | Full-time | On-site/Remote | Prague | Czech republic Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the Web—the largest source of i
15.
by mtrunkat 7y ago
Apify.com | Product Manager | Full-time | On-site | Prague, Czech republic Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the web—the largest so
16.
by mtrunkat 7y ago
Apify.com | Full-stack engineer | Full-time | On-site | Prague, Czech republic Apify builds software technology and infrastructure that helps small startups and the world’s biggest companies leverage the full potential of the web—the larges
17.
by mtrunkat 7y ago
Apify.com | Full-stack engineer | Full-time | On-site | Prague, Czech republic Apify runs on a highly-scalable infrastructure that processes almost a billion web pages every month. We run on a cluster of Linux servers on Amazon EC2 and st
18.
by mtrunkat 7y ago
Apify | Infrastructure engineer | Prague, Czechia | ONSITE Apify runs on a highly-scalable infrastructure that processes almost billion web pages every month. We run on a cluster of Linux servers on Amazon EC2, store data in MongoDB, Dynamo
19.
by mtrunkat 7y ago
Apify | Infrastructure engineer | Prague, Czechia | ONSITE Apify runs on a highly-scalable infrastructure that enables it to load and analyze millions of web pages every day. We employ a cluster of Linux servers running on Amazon EC2 and st
20.
by mtrunkat 8y ago
We have found 2 related issues: - Sometimes Promise returned by page.close() never resolves so it's good to call Promise.race() on that together with a Promise that resolves after some timeout period (30s?) - Sometimes Chrome process d
21.
by mtrunkat 8y ago
Problem with fixed concurrency is that required memory per Chrome process varies a lot. We ( https://www.apify.com ) are solving this by autoscaling number of parallel Puppeteer instances based on memory and CPU. Our open source S
22.
by mtrunkat 9y ago
Check out my previous blogpost - how to easily create a RSS feed for websites that don't have it https://blog.apify.com/how-to-turn-any-website-into-an-rss-f...
23.
by mtrunkat 9y ago
https://trello.com/ down also (EU)
24.
How to turn any website into an RSS feed(medium.com)
4 points by mtrunkat 10y ago|0 comments
25.
by mtrunkat 10y ago
Location: Prague, Czech republic Remote: Yes Willing to relocate: Possibly Technologies: NodeJS, PHP, Javascript, AWS, Linux Email: marek at trunkat.eu LinkedIn/Resume: https://www.linkedin.com/in/marektrunkat I a