Commit Graph

376 Commits (master)

Author SHA1 Message Date
Kevin Froman fb4dd07ba4 fix missed blockHash->block_hash change in onionrstorage 2020-08-17 19:02:51 -05:00
Kevin Froman 0b2658374b Added/corrected timeouts for sqlite3 database connections
Bumped mail plugin patch version for sqlite3 timeout change
Code formatting corrections
2020-08-16 19:52:50 -05:00
Kevin Froman 2a7c933321 Utils format fixes 2020-08-12 18:07:04 -05:00
Kevin Froman c9af24392d Fix netutils formatting 2020-08-12 17:30:12 -05:00
Kevin Froman 272d7d7f74 Removed Windows specific code 2020-08-12 17:21:11 -05:00
Kevin Froman ce63c4cd3b Show a terminal message if bridge is enabled but one is not set. By design, there is no easy way for us to get Tor bridges automatically
work on tor blocking detection
2020-08-12 13:16:13 -05:00
Kevin Froman 2ddeab8788 work on tor blocking detection 2020-08-11 23:49:26 -05:00
Kevin Froman a24086da62 add comments to bootstrappeers 2020-08-10 21:35:19 -05:00
Kevin Froman 8389ed190c Basic check for QubesOS in runtime tests and to avoid starting LAN server 2020-08-10 01:09:19 -05:00
Kevin Froman 87b8655b83 do not start lan on qubes 2020-08-10 01:03:32 -05:00
Kevin Froman feb8004c95 fix generating hashes not being removed when done, add endpoint to get generating hashes 2020-08-09 22:13:06 -05:00
Kevin Froman 3473c5e36a Improved torcontrol formatting and efficency 2020-08-08 21:18:56 -05:00
Kevin Froman e14955cb6b Improved formatting and removed unnecessary imports in torcontrol 2020-08-08 20:44:11 -05:00
Kevin Froman 5e00bb930f added client api request crafting script 2020-08-08 15:40:20 -05:00
Kevin Froman 6976dcf8f3 Friends API now shows redirect error message when ref header not set instead of request failing 2020-08-08 15:39:24 -05:00
Kevin Froman 96af4e8db0 Fixed some broken things from communicator decoupling 2020-08-08 12:38:14 -05:00
Kevin Froman bff2595ac9 Merge branch 'new-release' into sidebar 2020-08-08 10:51:04 -05:00
Kevin Froman 522cd2c462 bumped requirements versions 2020-08-08 00:11:45 -05:00
Kevin 077f530b72 Fix peeraction still using comm_inst 2020-08-07 21:57:02 -05:00
Kevin ab10cea8b6 add forgotten spawndaemonthreads and added license info to bulma extension files 2020-08-04 08:45:06 -05:00
Kevin 086f2f718c fix onlinepeers decoupling 2020-08-04 08:44:24 -05:00
Kevin 4cf17ffe62 work on removing communicator 2020-07-30 20:15:36 -05:00
Kevin 0b34aa7385 added onionrthreads to replace communicator timers 2020-07-29 20:36:41 -05:00
Kevin 6f1daf50d3 added setup kvvars 2020-07-29 20:36:11 -05:00
Kevin 5bde99967b Moved all communicator ext vars to KV 2020-07-29 04:32:09 -05:00
Kevin f28d469e56 Moved all communicator ext vars to KV 2020-07-29 03:57:06 -05:00
Kevin 080f33bf1f More decoupling, removed unnecessary announceCache 2020-07-26 21:45:17 -05:00
Kevin fad5e8547e Moved cooldownPeer to KV to further reduce coupling 2020-07-26 19:15:26 -05:00
Kevin dde10b7005 Moved offllinePeers to KV to further reduce coupling 2020-07-26 19:12:52 -05:00
Kevin 10c1cd7803 Moved blocksToUpload to KV to further reduce coupling 2020-07-26 19:02:39 -05:00
Kevin 97a5f50271 Moved dbTimestamps and newPeers to KV for more decoupling 2020-07-26 15:49:34 -05:00
Kevin e00d41f8a9 Moved onlinePeers and announceCache to kv for more decoupling 2020-07-26 15:26:15 -05:00
Kevin 6a6718c9fd Moved onlinePeers to KV to further reduce coupling 2020-07-25 22:28:32 -05:00
Kevin 0e4e7bb050 Moved communicator shutdown over to KV model for more decoupling 2020-07-25 21:36:48 -05:00
Kevin 6ecb62356a Moved blockQueue to DSKV singleton as part of communicator decoupling 2020-07-24 14:37:01 -05:00
Kevin 47013431d2 Removed use of communicator's storagecounter to reduce coupling 2020-07-24 03:27:42 -05:00
Kevin f4d1739e4a made storagecounter use a watchdog (inotify) instead of excessive file reads 2020-07-24 02:57:44 -05:00
Kevin 8b5c87d356 Removed single-process POW support, which was just needed on Windows 2020-07-23 15:16:52 -05:00
Kevin ac279c1cef bumped version 2020-07-21 21:57:44 -05:00
Kevin 9fc741106a made localcommand pep8 compliant 2020-07-17 13:49:18 -05:00
Kevin 782c980b69 formatting and comment improvements, cleanup 2020-07-07 09:11:30 -05:00
Kevin 714b3a3c33 cleaned up onionrblocks/insert/main some 2020-07-04 14:44:06 -05:00
Kevin 7931f514b6 Only hide blocks uploaded to us if we have outgoing peers (don't send to upload event handler) 2020-06-30 18:34:13 -05:00
Kevin c46e9590c6 share too_many to all requests (flask "g") handled by public security module 2020-06-30 17:17:22 -05:00
Kevin 3a6322c6c6 Remove _delay_wait_for_share_block_removal because it doesn't seem to exist 2020-06-30 17:16:33 -05:00
Kevin d6422801a2 don't set lookupblocks timestamp unless they actually have new blocks 2020-06-30 17:09:18 -05:00
Kevin 63e676ed6f cleanup lookupblocks 2020-06-30 17:08:32 -05:00
Kevin 3f13cd84ea * Do not print border around quotes when the terminal is small 2020-06-29 02:30:37 -05:00
Kevin 25485e6aa4 * Revert back to hiding blocks even when we have no outgoing connections
* ensure that block is hidden in public list in insert test
2020-06-29 02:29:55 -05:00
Kevin 1aa707cea5 Do not run LANserver runtime test if we are not on an appropriate LAN (such as VMs/VPS) 2020-06-29 02:28:50 -05:00
Kevin 049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin 7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin 6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin 0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin 27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin 1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin 1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin 8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin 6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin 7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin 34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin 7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin 5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin 1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin 5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin 1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin 0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin 88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin 3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin 3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin 2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman 7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman 026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman 39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman 37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman 8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman 8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman 0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman 09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman 1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman 012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman 62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman 1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman 2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman 2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman 9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman 481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman 4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman 2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman 3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman 022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman 6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman 69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman 24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman 68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman 9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman 3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman 92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman 18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman 7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman 25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman 04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman 60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman 665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman 02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman 862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman 6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman 56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00