You might see that the Dropbox Community team have been busy working on some major updates to the Community itself! So, here is some info on what’s changed, what’s staying the same and what you can expect from the Dropbox Community overall.
Forum Discussion
reading parquet file using python sdk
Hi, I am trying to read a parquet file using pandas and vaex. I can sucessfully read a .csv but I get the following error message when I try to download the parquet file with dbx.files_download : ...
Thanks for following up and sharing that. For reference, the URL parameters for shared links like that are documented here.
I understand, and I found out it's possible. I put this here as it might help someone else.
You can use copy link (set the permissions as you like) and use the URL inside pandas.read_csv or pandas.read_parquet to read the dataset.
However the copy link will have a 'dl' parameter equal to 0, you have to change it to 1 to make it work. Example:
# this does not work
df = pd.read_parquet('https://www.dropbox.com/s/somecode/part.0.parquet?dl=0')
# this works
df = pd.read_parquet('https://www.dropbox.com/s/somecode/part.0.parquet?dl=1')
Thank you again for helping out
Greg-DB
Dropbox Staff
Dropbox StaffThanks for following up and sharing that. For reference, the URL parameters for shared links like that are documented here.
About Dropbox API Support & Feedback
Find help with the Dropbox API from other developers.
