set up parallelization #7

So there are a couple of ways to parallelize things.

I think I'll handle parallelization by dividing NCTIDs among X number of groups,
and then setup the python code to reserve a group to work on.
Then it will run each group.

I could use the database to coordinate what should be done?
Alternatively I might set up a python project.

So there are a couple of ways to parallelize things. I think I'll handle parallelization by dividing NCTIDs among X number of groups, and then setup the python code to reserve a group to work on. Then it will run each group. I could use the database to coordinate what should be done? Alternatively I might set up a python project.

I've got parallelization basics setup but need to implement a way to slow down requests across a machine/interface.

Parallelization is implemented, have another issue handling rate limiting.

Labels Milestones

set up parallelization #7