Commit Graph

59 Commits (bbf8c77e6d26745a2689e2fe00f235c66446bfba)
 

Author SHA1 Message Date
will king bbf8c77e6d more work on linking market data 3 years ago
youainti 4283719d3d added stashed changes 3 years ago
youainti 52f8152afd merging results 3 years ago
youainti 23826fb576 recording local changes 3 years ago
will king 966171c840 checking in incremental work. Figured out how to get dates. 3 years ago
will king f5788051f7 removed (reasonably successful) attempt at using API. I favor migrading db tables 3 years ago
will king 97af862419 added RxNavInABox mariadb -> postgres importation and some of the views etc I am developing. 3 years ago
youainti 4cc4c5c99f Got some basic api testing done. 3 years ago
youainti fa37dccfff setup downloader and tool to load nsde data to database 3 years ago
youainti 339a83117e updated justfile and added a sample .env file 3 years ago
youainti 266c1c9686 Created downloader, table, and loader for market data 3 years ago
youainti dfbd82de54 Added instructions to README, improved downloader and adjusted justfile recipe to accomodate downloader 3 years ago
youainti fc38a2e92c Fixed bug related to statuses sometimes containing notes 3 years ago
youainti 3eb9a4130a Got parsing updated to new format 3 years ago
youainti ee3e37e834 Added history schema, got extraction_lib to read and write from db 3 years ago
youainti 4ae3064bf2 Got the historical downloader working (fixed an sql issue) and setup tools to select trials. 3 years ago
youainti 61dc377e0a reworked docker compose 3 years ago
youainti 321e756cc6 Merge branch 'parser' of ssh://gitea.kgjk.icu:3022/Research/ClinicalTrialsDataProcessing into main 3 years ago
youainti 5d2140accd simplified and renamed justfile recipes 3 years ago
youainti 9b26cd99df Simplified the DB creation process by running a postgres container directly 3 years ago
youainti 1bdcc2fd83 added documentation 3 years ago
youainti 4a2b1ea2ed justfile will download, create, and populate db with AACT data 3 years ago
youainti 91eeea100e got downloads working 3 years ago
youainti e240fff07c Added a justfile, adjusted docker networks, restructured how data is downloaded 3 years ago
youainti a2c0e4dcc7 added graph of data linkages 4 years ago
youainti e4971ae2f6 checking everything in 4 years ago
youainti f3d73a5ac1 Added instructions on extracting other data 4 years ago
youainti 9d5a726494 added feature to extract start_date. deleted unused files and modified others for ease of use. 4 years ago
youainti 453e82974e extraction-lib as a functional module and the associated history file. 4 years ago
will king a9027c9467 added another test file 4 years ago
will king b1c146d550 Mostly working data extraction, removed dependency on text processing (will remove in future commit) 4 years ago
will king 71e87a9abe Saving current status. 4 years ago
will king d8d00101fa Started building data extraction tools 4 years ago
youainti 9850f4c677 setting up the extraction tools and including test cases. 4 years ago
youainti ff2c5b9ddd Added rate limiting functionality. Not tested as things ran just fine for the 1700 trials I downloaded. 4 years ago
youainti e849ee50be added a test for downloading issues 4 years ago
will king 4bf9b4fab9 Testing if db_connection will work over tailscale. It does. 4 years ago
will king 40a34ae1c3 Merging something I accidentally committed into main instead of history-download 4 years ago
will king bf28ad30b2 Fixed version extraction 4 years ago
youainti d3f20ca817 Fixed trial reservation issues by adjusting when the reservation querey is written to the db 4 years ago
youainti 5bd3d4ee95 updated table definitions for views so that they deliver the correct information 4 years ago
youainti 2aa8fdee4e reservations working properly. Still missing rate control 4 years ago
youainti 820f082e0d added documentation comments to classes and functions 4 years ago
youainti 9623bc0550 Housekeeping: Renamed folder to distinguish between aact and history downloader. Updated .gitignore to handle orangebook data 4 years ago
youainti 84b38166e1 updates to AACT downloader schemas to match what I am actually using. 4 years ago
youainti 5a1f744449 Adding attempts at orangbook processing. The CID parser stuff is in case I need to parse the pdfs 4 years ago
youainti e97434f70a removing previous attempts at parsing 4 years ago
youainti 725839df5b have the basics of a downloader and the sql to support it. 4 years ago
youainti 8fbe2c94e9 separated postgres from pgadmin 4 years ago
youainti 9dfae547ce began rewriting README 4 years ago