wjones/new_dbsync
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
16 Commits 3 Branches 0 Tags
a18c6a7386d61a843b63258f5b79f7cbdf7feb99
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
wjones a18c6a7386 Add PostgreSQL virtual table extension and SQLite utilities 
- Implement pg_vtab as a minimal SQLite virtual table module backed by PostgreSQL.
- Create sqlite2pgsql utility for copying tables from SQLite to PostgreSQL.
- Add sqlite_pg_plugin to expose PostgreSQL tables to SQLite.
- Include Makefile for building the pg_vtab shared object.
- Update README with usage instructions and limitations.
- Remove obsolete cache.zip file.
2025-12-11 18:45:49 +00:00
api
repo migration
2025-05-20 12:02:07 -04:00
cache
Refactor code structure for improved readability and maintainability
2025-11-14 16:24:06 -05:00
db
Implement bulk upsert functionality in dbmongo class and update configuration for MongoDB database
2025-12-11 15:20:50 +00:00
jprocessor
removing cache folder and view and json files are no longer used.
2025-06-27 15:08:11 -04:00
logs
repo migration
2025-05-20 12:02:07 -04:00
settings
Implement bulk upsert functionality in dbmongo class and update configuration for MongoDB database
2025-12-11 15:20:50 +00:00
temp
Refactor code structure for improved readability and maintainability
2025-11-14 16:24:06 -05:00
url
repo migration
2025-05-20 12:02:07 -04:00
yaml_ddl
working on json2postgres.py file
2025-06-25 09:17:45 -04:00
.gitattributes
repo migration
2025-05-20 12:02:07 -04:00
.gitignore
repo migration
2025-05-20 12:02:07 -04:00
json2postgres.py
fix code for all tables in json2postgres.py so all tables get processed now. Update requirements.txt to include pandas.
2025-06-25 16:13:34 -04:00
json_downloader.py
Add timestamp conversion for updated fields in dbmongo class and clean up json_downloader.py
2025-12-09 16:00:25 -05:00
Makefile
Add PostgreSQL virtual table extension and SQLite utilities
2025-12-11 18:45:49 +00:00
pg_vtab.c
Add PostgreSQL virtual table extension and SQLite utilities
2025-12-11 18:45:49 +00:00
README_pg_vtab.md
Add PostgreSQL virtual table extension and SQLite utilities
2025-12-11 18:45:49 +00:00
README.md
working on json2postgres.py file
2025-06-25 09:17:45 -04:00
requirements.txt
fix code for all tables in json2postgres.py so all tables get processed now. Update requirements.txt to include pandas.
2025-06-25 16:13:34 -04:00
sqlite2pgsql
Add PostgreSQL virtual table extension and SQLite utilities
2025-12-11 18:45:49 +00:00
sqlite_pg_plugin.py
Add PostgreSQL virtual table extension and SQLite utilities
2025-12-11 18:45:49 +00:00
update_mongo.py
Implement bulk upsert functionality in dbmongo class and update configuration for MongoDB database
2025-12-11 15:20:50 +00:00

README.md

DBSyncer

This project has two parts: 1.) it uses the tvmaze API to download Television dat and store it in a mongodb database. 2.) Takes saved json data and inserts/updates data in a postgresql database.

Learn more about creating GitLab projects.

Reference in New Issue View Git Blame Copy Permalink
S
Description
No description provided
Readme 592 MiB
Languages
Python 99.9%