I have started work as a new user with an existing Exosite application.
The project has been underway with live users since 2014.
I need to collect some past data on the order of about 1MM data readings.
I can certainly narrow that down by CIK and time period to whatever is practical.
Does anyone here have a recommendation for the fastest way I can get these readings in bulk form to load into another application?
I have access to whatever resources I need in terms of compute and storage - and the python code that exists uses a 1 reading-at-a-time approach that will not be able to get the data for me fast enough for my needs at present - this is more or less a one-time need so that i can process this data in another application.