4 ms·

Looks really nice, but I tried it: import sketch import pandas as pd data_pd = pd.read_csv("input.csv", sep=';') print(data_pd) print(data_pd.sketch

Looks really nice, but I tried it: import sketch import pandas as pd data_pd = pd.read_csv("input.csv", sep=';') print(data_pd) print(data_pd.sketch.ask("Is there any PII in this dataset ?")) print(data_pd.sketch.ask("Which columns are integer type?")) With this input.csv: name;age;address;phone Bob;34;106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD;1-541-754-3010 Anna;34;694 Short Street, Austin, Texas;001-541-754-3010 And I have no results (and no runtime error as well) :-( Here is the console output: name age address phone 0 Bob 34 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1-541-754-3010 1 Anna 34 694 Short Street, Austin, Texas 001-541-754-3010 <IPython.core.display.HTML object> None <IPython.core.display.HTML object> None Am I missing something ? The "ask" interface doesn't seems to need external OpenAI credentials right ?

bluecoconut 4y ago
to get the strings of the results back out, add the kwarg `call_display=False` to the functions. so: ``` print(data_pd.sketch.ask("Is there any PII in this dataset ?", call_display=False)) ``` should work for you. Right now it by default assumes its in an ipython context that can display HTML objects.
- tdebroc 4y ago
  Ah yes it displayed the string, thanks! But the result looks wrong with this input: age address 0 34 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1 34 694 Short Street, Austin, Texas It says: No, there is no PII (personally identifiable information) in this dataset. The only columns are index, age, and address, none of which contain any sensitive information. Sometimes, it seems to work with phone number though. Here: age address phone 0 34 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1-541-754-3010 1 34 694 Short Street, Austin, Texas 001-541-754-3010 Yes, this dataset contains PII (personally identifiable information) such as age, address, and phone number. I retried: pirce address phone 0 123 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1-541-754-3010 1 43543 694 Short Street, Austin, Texas 001-541-754-3010 No, there is no personally identifiable information (PII) in this dataset. The columns contain only generic information such as index, price, address, and phone number. None of these columns contain any information that could be used to identify an individual. Which is wrong. Is there explanation ?

bluecoconut 4y ago

to get the strings of the results back out, add the kwarg `call_display=False` to the functions. so: ``` print(data_pd.sketch.ask("Is there any PII in this dataset ?", call_display=False)) ``` should work for you. Right now it by default assumes its in an ipython context that can display HTML objects.

tdebroc 4y ago
Ah yes it displayed the string, thanks! But the result looks wrong with this input: age address 0 34 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1 34 694 Short Street, Austin, Texas It says: No, there is no PII (personally identifiable information) in this dataset. The only columns are index, age, and address, none of which contain any sensitive information. Sometimes, it seems to work with phone number though. Here: age address phone 0 34 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1-541-754-3010 1 34 694 Short Street, Austin, Texas 001-541-754-3010 Yes, this dataset contains PII (personally identifiable information) such as age, address, and phone number. I retried: pirce address phone 0 123 106 DOYERS ST. 8 ARLINGTON DR. 599 NW BAY BLVD 1-541-754-3010 1 43543 694 Short Street, Austin, Texas 001-541-754-3010 No, there is no personally identifiable information (PII) in this dataset. The columns contain only generic information such as index, price, address, and phone number. None of these columns contain any information that could be used to identify an individual. Which is wrong. Is there explanation ?