locsec/twscrape
1
Форкнуть 0
зеркало из https://github.com/viginum-datalab/twscrape.git synced 2025-10-28 20:54:24 +02:00
Код Задачи Пакеты Проекты Релизы Вики Активность

Граф коммитов

  • dcfbfade4e Handle dependency error Niels Ørbæk Chemnitz 2023-10-09 16:14:02 +02:00
  • 8eb9011842
         Merge branch 'vladkens:main' into main stygmate 2023-09-27 09:21:40 +02:00
  • 20339b3931
         Merge pull request #71 from aatakansalar/main vladkens 2023-09-19 19:26:35 +03:00
  • 0f7f2d1ded correction of bad rawContent reconstruction for RT stygmate 2023-09-15 12:44:22 +02:00
  • a1e60203ff Get RT and QT when they are in objects of type TweetWithVisibilityResults stygmate 2023-09-15 12:03:43 +02:00
  • 4f5d3d6f4f Fixing Email Verification Token Retrieval Issue aatakansalar 2023-09-13 04:08:03 +03:00
  • 745bc59b66 v0.8.0 Vlad Pronsky 2023-09-08 20:49:01 +03:00
  • d53535f16c update gql endpoints Vlad Pronsky 2023-09-08 20:47:13 +03:00
  • a742fe658e improve sqlite version check, reduce minimal version #58 Vlad Pronsky 2023-09-08 20:11:18 +03:00
  • 4d8c91a211 TweetWithVisibilityResults #53 Vlad Pronsky 2023-09-08 18:04:25 +03:00
  • 99bf64028e update mocks; fix full context parsing for tweets with rt Vlad Pronsky 2023-09-08 17:41:07 +03:00
  • 462739b5d9 fix parsed links count #56 Vlad Pronsky 2023-09-08 17:01:11 +03:00
  • 4f2ee7ff8e
         Merge pull request #52 from melroy89/main-1 vladkens 2023-08-27 15:31:18 +03:00
  • f88692e6c8
         Merge pull request #57 from entasadar/fix_email_login vladkens 2023-08-27 15:31:08 +03:00
  • 9643fdb5d7
         fix email login Vladimir Tolmachev 2023-08-16 12:04:20 +04:00
  • 7dd7afd637
         Update pyproject.toml Melroy van den Berg 2023-08-10 23:40:41 +02:00
  • 86fcafc308 v0.7.0 Vlad Pronsky 2023-07-30 17:31:03 +03:00
  • 272afb996c disable for limit at now #26 Vlad Pronsky 2023-07-30 17:30:45 +03:00
  • aa69c653ef restore full tweets text in case of retweet #42 Vlad Pronsky 2023-07-30 17:24:07 +03:00
  • bce3bac8be add example of parallel processing #47 Vlad Pronsky 2023-07-30 16:47:45 +03:00
  • 1230e32186 fix cli flag for check email fist; update parser Vlad Pronsky 2023-07-30 16:21:17 +03:00
  • fbbe4b61a9 user_by_id / user_by_login / tweet_details return none in case of resource not accessible api; add dump when parsing failed Vlad Pronsky 2023-07-30 15:37:43 +03:00
  • a378a9721e print log when account available for queue Vlad Pronsky 2023-07-30 15:15:47 +03:00
  • 8f28bd1258 infinite retry for http timeout / proxy error (was lock account for some long time) Vlad Pronsky 2023-07-30 15:15:20 +03:00
  • e87e4ea6da add more format of cookies to parse Vlad Pronsky 2023-07-30 15:14:34 +03:00
  • 2c1c0cce97 restore login by flow as was in 0.5 (check email first as param) Vlad Pronsky 2023-07-30 15:14:10 +03:00
  • 95b9a12d47
         Added blue and blueType fields into User model (#38) Oleg Sviatchenko 2023-07-23 16:59:46 +06:00
  • 74594d0b9d fix lint Vlad Pronsky 2023-07-15 03:22:31 +03:00
  • 686ebe5250 v0.6.0 Vlad Pronsky 2023-07-15 03:19:03 +03:00
  • f43bf3cd16 update limit in non _raw functions Vlad Pronsky 2023-07-15 03:18:15 +03:00
  • a3bb5d2dc8 update api errors handling Vlad Pronsky 2023-07-15 02:25:49 +03:00
  • 8986758666 update logs; print next available account time for queue Vlad Pronsky 2023-07-15 00:39:49 +03:00
  • 95886e6b50 check email before login; update logs Vlad Pronsky 2023-07-14 23:50:32 +03:00
  • 895ec22e22 update readme Vlad Pronsky 2023-07-14 23:36:08 +03:00
  • 4938ca7d6c add account import with cookies; update mocks Vlad Pronsky 2023-07-14 23:10:06 +03:00
  • 22c29b673d gql endpoints update; debug replies Vlad Pronsky 2023-07-14 16:06:04 +03:00
  • 87ef50878d ability to reset locks for accounts; update replies dumps Vlad Pronsky 2023-07-12 14:34:05 +03:00
  • 7866e44ade feat: add processing of api error when code=200 Vlad Pronsky 2023-07-10 23:34:07 +03:00
  • 42357d0233 feat: simplify api usage Vlad Pronsky 2023-07-09 16:43:48 +03:00
  • 6bceb0a6bf feat: ability to remove account; show stats for login_all method in cli Vlad Pronsky 2023-07-09 16:43:23 +03:00
  • 308ba9d196 update readme Vlad Pronsky 2023-07-09 16:42:29 +03:00
  • 7f869efe95 release 0.5.0 Vlad Pronsky 2023-07-07 12:59:07 +03:00
  • 43170308c5 fix: test runner Vlad Pronsky 2023-07-07 12:57:59 +03:00
  • 3710d2605f feat: ability to pass starting cursor #16 Vlad Pronsky 2023-07-07 12:43:27 +03:00
  • 9238398b3c feat: update tweets parser (viewsCount, retweetedTweet, quotedTweet) #28 Vlad Pronsky 2023-07-07 12:25:50 +03:00
  • 364c0ddfd0 update queue_client errors handling Vlad Pronsky 2023-07-07 01:40:53 +03:00
  • 852675954e feat: added list_timeline (#20) Vlad Pronsky 2023-07-07 00:49:37 +03:00
  • 4eb4a65a10 feat: current usage overview in cli Vlad Pronsky 2023-07-07 00:36:29 +03:00
  • 99286a11cc feat: long tweet text support Vlad Pronsky 2023-07-07 00:08:30 +03:00
  • 3b116155aa feat: relogin accounts Vlad Pronsky 2023-07-06 23:57:44 +03:00
  • c35dcb902c fix: tweet_details crash when tweet not found (now is None) Vlad Pronsky 2023-07-06 20:26:48 +03:00
  • 18a3e3b3e0 release 0.4.2 Vlad Pronsky 2023-07-06 13:52:23 +03:00
  • 070aa71583 improve queue client logic; update readme Vlad Pronsky 2023-07-06 13:20:27 +03:00
  • 7b94895cd5 update funding Vlad Pronsky 2023-07-06 00:52:56 +03:00
  • 034ce8ae70 release 0.4.1 Vlad Pronsky 2023-07-06 00:41:42 +03:00
  • 0f56055cb1 cli: sort account by last_used Vlad Pronsky 2023-07-06 00:39:52 +03:00
  • 86d10b19dc fix: account was NOT locked after failed request Vlad Pronsky 2023-07-06 00:39:29 +03:00
  • 96cacbac2b add gql search api handler to pool.stats; update tests; remove table head lines from cli/accounts Vlad Pronsky 2023-07-05 21:47:37 +03:00
  • 5e4f5392d8 fix: urls in user profile Vlad Pronsky 2023-07-05 00:17:40 +03:00
  • 65f40c9a5a fix: handle 401 error as normal situation and switch account Vlad Pronsky 2023-07-04 15:20:53 +03:00
  • 3654a053da feat: add profile urls to user model Vlad Pronsky 2023-07-04 15:09:00 +03:00
  • aa4fbc8cad feat: update search api to gql Vlad Pronsky 2023-07-04 15:08:33 +03:00
  • d0479e2ece fix: user_by_login endpoint in cli Vlad Pronsky 2023-07-04 14:29:43 +03:00
  • 020754446e fix: double escaped json in cli for non raw results Vlad Pronsky 2023-07-01 12:30:22 +03:00
  • 815189e277 release 0.3.0 Vlad Pronsky 2023-06-23 14:15:40 +03:00
  • f31046d8c4 feat: media parser Vlad Pronsky 2023-06-22 23:16:37 +03:00
  • 8ccf3b6357 fix: cli --raw response in json string (was stringified python dict) Vlad Pronsky 2023-06-18 16:24:43 +03:00
  • cd0a8198d0 add is_str to models to work in other environments (eg. javascript) Vlad Pronsky 2023-06-18 16:11:08 +03:00
  • 3c55f3c9e3 release 0.2.2 Vlad Pronsky 2023-06-06 02:43:01 +03:00
  • 99695dc24d fix sqlite 3.34 Vlad Pronsky 2023-06-06 02:32:14 +03:00
  • 2265a92f0d add changelog to makefile Vlad Pronsky 2023-05-29 01:54:01 +03:00
  • 9ec06ec24a join cli version & sqlite_version commands Vlad Pronsky 2023-05-29 01:41:45 +03:00
  • 2da6958383 update version Vlad Pronsky 2023-05-29 01:37:56 +03:00
  • 1157f0e7f9 show sqlite version from cli Vlad Pronsky 2023-05-29 01:35:17 +03:00
  • 1863196324 update ci Vlad Pronsky 2023-05-29 01:00:46 +03:00
  • fae0a9db97 update readme Vlad Pronsky 2023-05-29 00:47:04 +03:00
  • 547491ed2a update readme Vlad Pronsky 2023-05-29 00:44:23 +03:00
  • 8f9f418a6c fix lint Vlad Pronsky 2023-05-29 00:42:42 +03:00
  • e3e1ee18fe update version Vlad Pronsky 2023-05-29 00:36:28 +03:00
  • 2492de1417 add ability to add accounts & login from cli Vlad Pronsky 2023-05-29 00:28:57 +03:00
  • d3d6a002f2 ability to modify gql params Vlad Pronsky 2023-05-28 22:26:34 +03:00
  • 9735559c49 update tests with fixture magic Vlad Pronsky 2023-05-28 21:03:02 +03:00
  • d2cf6783d8 add description of accounts usage (for #7) Vlad Pronsky 2023-05-28 19:09:34 +03:00
  • d90232c47d add example of accounts_info command Vlad Pronsky 2023-05-28 19:08:47 +03:00
  • 52c5b2048b update readme with cli commands Vlad Pronsky 2023-05-28 18:59:09 +03:00
  • 719c972d96 add cli runner Vlad Pronsky 2023-05-28 17:50:12 +03:00
  • 09bb27485b add account last_used & stats fields Vlad Pronsky 2023-05-25 15:12:36 +03:00
  • 3333692a32 add error on unsupported sqlite version Vlad Pronsky 2023-05-25 05:44:18 +03:00
  • c0204aa492 move http communication from api class; handle network fail cases; add tests Vlad Pronsky 2023-05-25 05:08:20 +03:00
  • 1ad12528d2 Update accounts_pool.py Michael Mitchell 2023-05-17 21:21:35 -07:00
  • f3576b8ccc Merge branch 'sync' Vlad Pronsky 2023-05-16 13:07:22 +03:00
  • 27d876c16a add badges to readme Vlad Pronsky 2023-05-16 13:04:20 +03:00
  • 148ff2ad95 ignore ci on tags push; update pyproject Vlad Pronsky 2023-05-09 22:32:29 +03:00
  • a72a86c8c6 ignore ci on tags push; update pyproject Vlad Pronsky 2023-05-09 22:32:29 +03:00
  • eaee58aaa1 ignore ci on tags push Vlad Pronsky 2023-05-09 22:27:06 +03:00
  • 2587a62f3e fix timezone issue; add _type to models Vlad Pronsky 2023-05-09 22:23:22 +03:00
  • 799f6c330a update readme Vlad Pronsky 2023-05-09 19:40:11 +03:00
  • cabef7f826 update ci Vlad Pronsky 2023-05-06 16:57:12 +03:00
  • ae6eabe271 rename project; add retries Vlad Pronsky 2023-05-06 15:48:03 +03:00
  • 3555542009 redo storage on sqlite Vlad Pronsky 2023-05-05 23:31:49 +03:00