I have a few users who will be uploading a few types of predefined CSV files. I need to store these as sql tables to be able to run queries on this data for a particular user, however that means there’s potentially going to be loads of tables.
Right now I’m storing the csv’s in an s3 bucket with the key
What would be the best way to transform it into SQL? I have CSV parsing done using nodes fast-csv, it’s just the schema that’s baffling.
I was thinking table names like
data-username-filename so each user will have as many tables as csv categories, so 10 tables each. Would it be best to store this in a seperate DB or the same DB just differntiating by table name/prefix?
This is a backoffice app with only a few users.
One option is to use different schemas per user, and then tables with the convention you want.
CREATE TABLE '<user_id>'.'<filename>'...