12bdb50787
fix missing site param from downloadUsers
2025-01-21 20:41:45 -05:00
394370fb55
download bsky support
2025-01-21 20:30:04 -05:00
a0f7e16fc3
begin to support bsky
2025-01-21 20:29:38 -05:00
e806dc23ae
fix wrong "users left" count due to skipped
2024-03-03 13:06:16 -05:00
fc3b6800c8
split skip params
2024-02-29 22:44:13 -05:00
018ab6f193
Update README.md
2024-02-29 00:18:39 -05:00
f68db2fb4d
Update run-downloadDb.js
2024-02-28 22:26:51 -05:00
b917b77e71
add batching
2024-02-28 22:24:24 -05:00
2f023b919c
fix use of createDb
2024-02-28 20:50:46 -05:00
b7a7f97a28
Update schema.js
2024-02-28 18:47:55 -05:00
accc1eab6d
Update schema.js
2024-02-28 18:47:13 -05:00
4634b1d455
Update schema.js
2024-02-28 18:46:21 -05:00
d36a0a8253
cleanup
2024-02-28 18:42:50 -05:00
a20a20b3ce
skip /search if errors or skipped /media
2024-02-28 18:37:09 -05:00
804b1cefc2
replace inaccurate proc count with remaining procs
2024-02-28 17:54:27 -05:00
a76a393a12
Update run-downloadDb.js
2024-02-25 15:04:23 -05:00
78ceefe33f
fix initDb always running in downloadDb
2024-02-23 23:31:07 -05:00
5c73399f5c
Update README.md
2024-02-19 12:32:30 -05:00
ae2d467a4d
log typo
2024-02-19 00:05:45 -05:00
7638c38a6d
media download log colors
2024-02-18 23:50:22 -05:00
d76871d3ac
v0 -> v1 db, support adding multiple users
2024-02-18 23:50:08 -05:00
3f7f929972
fix negative running single user db save fail
2024-02-15 23:34:43 -05:00
cb4effa348
fix /search mode prematurely starting
...
sometimes 'exit' would be called before 'close', and 'close' didn't do the safety check 'exit' did, making `--running` run twice; additionally, proc.exitCode was always null, check codeOrError instead from the proc.on callback
2024-02-14 22:32:00 -05:00
352bb03a90
create db during downloadDb if it is missing
2024-02-13 23:51:43 -05:00
4efcaf013b
create downloadUser for amending individual users
2024-02-13 17:51:56 -05:00
060d49261b
use UTC for timestamps and provide deduplicator
2024-02-12 18:45:34 -05:00
ef16b61219
reduce padding in output
2024-02-12 17:01:13 -05:00
04d110d8fe
update db file with lastUpdated
2024-02-10 15:13:28 -05:00
4abf2ef021
Update README.md
2024-02-10 15:08:03 -05:00
3933505fc6
better error handling
...
- rate limit is stderr, so need to check to make sure only finishing on other errors
- color errors in log
- log errors to userDb
- use fallback date in case dates weren't logged (e.g. /media failed)
- report on not-found users, which may indicate a username change or deleted account
- report on authorization errors
2024-02-10 15:07:54 -05:00
cd87d2e244
Update README.md
2024-02-09 23:17:32 -05:00
2eca690d7f
Update README.md
2024-02-09 23:07:27 -05:00
3c2b9afc13
docs
2024-02-09 23:03:22 -05:00
eec7e72ce0
handle /search API after running /media requests
2024-02-09 22:28:41 -05:00
cae6761d24
docs
2024-02-09 21:13:23 -05:00
121452e1c9
organize
2024-02-09 20:43:24 -05:00
eb908dd8f0
concurrent retrieval with user-limited threadcount
2024-02-09 20:31:21 -05:00
0a9af1b964
initDb
2024-02-09 17:28:12 -05:00
89d5f437f5
logger
2024-02-09 17:27:55 -05:00
7997891cfc
arg parser
2024-02-09 17:27:51 -05:00
c302f1b105
init
2024-02-09 17:27:28 -05:00
