yosai

8 ms·

31.
by yosai 4y ago
@Mystery-Machine happy to get your detail feedback on the Readme.We will correct it.
32.
by yosai 4y ago
@hermitcrab here we mean no code /low code for validation template creation.We are not a ETL tool.Yes we do ETL operation internally.YoBulk is a flatfile.com alternative and primarily meant for data donor..we provide a spreadsheet view
33.
by yosai 4y ago
@justeleblanc we do auto column matching through open AI..Ex:If you have defined a template with column name Date of Joining and the CSV data donor upload a CSV with a field DOJ,then your validation engine will skip the importing as it does
34.
by yosai 4y ago
@nerdponx Yes YoBulk provides a way to write JSON schemas by hand..We have added some custom keyword like validate which is not defined in JSON standard..But our validation engine can understand that..You can pass a javascript function thro
35.
by yosai 4y ago
@bcrl we provide our own schema which is understood by our validation engine.It's an user option to use GPT or not..GPT output always comes with an disclaimer which might not be correct..We will be solving that slowly..
36.
by yosai 4y ago
@nerdponx You are spot on..
37.
by yosai 4y ago
@sgerenser Yes CSV is everywhere..YoBulk is smartly positioning itself for the data donor/provider or customer..It is the end customer or data provider who bite the bullet and do the time consuming data cleaning.The customer should kno
38.
by yosai 4y ago
@data_ders We realized that more than 70% of business data is shared in CSV and Excel formats, and only a small percentage use API integrations for data exchange..So CSV is here to stay for sure..On the other side,data engine is a sub modul
39.
by yosai 4y ago
There are multiple use cases where we are using Open AI Example:uploaded CSV's column to template column string matching
40.
by yosai 4y ago
@l33t233372 you are absolutely spot on.
41.
by yosai 4y ago
@nerdponx Open AI only generate a validation schema.We have our own schema generation engine for any custom validation which can be used where Open AI is not able to understand or generate correct schema.Yes you are absolutely right.Open AI
42.
by yosai 4y ago
@0live Cleaning data is only a module.YoBulk helps you to automate complete CSV import workflow.please read our blog https://www.yobulk.dev/blog/Building%20an%20In-house%20CSV%2... to understand the CSV workflow proble
43.
by yosai 4y ago
@anoonmoose we have an internal pipeline which streams the monogoDB data to any CSV or any webhook url path.it's a export pipeline which streams the processed data to CSVs.We will expose an API in coming days which will fit your usecas
44.
by yosai 4y ago
We are using OpenAI to only to create schema, column matching and Regex generation.No CSV data are sent to open AI..
45.
by yosai 4y ago
No datas are sent to any 3rd party.YoBulk is self hosted.Your personal information is stored on your database.Feel free to ask any data security related question.
46.
by yosai 4y ago
@yarapavan Thanks.Please explore the product!!
47.
by yosai 4y ago
@dstala thanks for exploring YoBulk.Under the hood,YoBulk uses Open AI apis which takes the uploaded CSV column name and template column as an input and gives accurate matching.You can try the product and let me know if you have any comment
48.
by yosai 4y ago
YoBulk uses buffer streaming internally.So you can upload a CSV of GBs size.You can try once at your end and let me know your feedback.
49.
by yosai 4y ago
Hey Everybody, We are really excited to open source YoBulk today. YoBulk is an open source CSV importer for any SaaS application - It's a free alternative to https://flatfile.com/ Why are we building YoBulk: In our pre
50.
Show HN: Yobulk – Open-source CSV importer powered by GPT3(github.com)
233 points by yosai 4y ago|109 comments