Commit Graph

376 Commits (master)

Author SHA1 Message Date
Kevin 049956544e improve upload error log messages 2020-06-28 04:18:00 -05:00
Kevin 7f8e63f19b keep trying to connect to new peers eagerly if we have no outgoing connections 2020-06-28 04:17:45 -05:00
Kevin 6738eaf222 don't hide uploaded blocks if we have no peers 2020-06-28 04:16:55 -05:00
Kevin 0d58d57467 add line break to a quote 2020-06-28 04:15:58 -05:00
Kevin 27adbbb199 swap spock for snowden in quotes 2020-06-27 18:05:53 -05:00
Kevin e9bbd38aab improve verifypow error message info to show affected block 2020-06-27 18:05:39 -05:00
Kevin cc41ad793e correct gettortransport endpoint tor config reading to use int and not bool 2020-06-27 18:05:04 -05:00
Kevin b878faeb4c fix bug where onionr would complain while restarting about not being able to start 2020-06-27 18:03:20 -05:00
Kevin ee28aba792 do not bind to lan if there is no lan 2020-06-25 23:44:39 -05:00
Kevin 1aea6c3362 don't show tor transport box if there is none 2020-06-25 03:29:27 -05:00
Kevin 1bf365aff4 disable lan if there is a local threat (sec level >=3) 2020-06-25 03:28:59 -05:00
Kevin 8d33e1a188 added sqlite3 check for weird python setups 2020-06-23 04:16:40 -05:00
Kevin 6c75c525d2 added gettoraddress private endpoint 2020-06-21 17:54:30 -05:00
Kevin 7d8c3f75e4 fix formatting in httpapi security 2020-06-21 15:48:00 -05:00
Kevin Froman a24c87c5b0 fix lan server test for real this time 2020-06-21 14:23:46 -05:00
Kevin 34416c07fe made particles more efficient, finished basic blocks feed 2020-06-21 02:27:55 -05:00
Kevin c81df9093d added particles and some code for recent block listing 2020-06-20 05:31:51 -05:00
Kevin c9a6769be7 fix lan server test not using raw 2020-06-19 01:29:47 -05:00
Kevin 7205189d62 make lan server test only a few ports, add run time test grace period in service detection attack prevetion mechanism 2020-06-19 01:08:39 -05:00
Kevin 5751468e8a remove deprecated POW 2020-06-19 00:55:37 -05:00
Kevin eeab5ef2c2 basic lan syncing support is done 2020-06-19 00:55:13 -05:00
Kevin bae8b38f08 handle ping missed in lan connecting 2020-06-17 00:53:33 -05:00
Kevin c0b72f9007 handle ping missed in lan connecting 2020-06-17 00:42:40 -05:00
Kevin 1f2c116b4b handle ping missed in lan connecting 2020-06-17 00:37:11 -05:00
Kevin 5b9bb2e5e2 made lan port identification faster 2020-06-17 00:29:03 -05:00
Kevin 1e76990d1e made lan port identification faster 2020-06-17 00:00:52 -05:00
Kevin 0c7afa89f1 fix setup_online_mode in daemon launch 2020-06-16 02:12:05 -05:00
Kevin a10a32fafb improved documentation + refactored daemonlaunch 2020-06-14 19:08:17 -05:00
Kevin 88824b7913 update runtime test result 2020-06-13 18:18:24 -05:00
Kevin 3c7b090a4e Merge branch 'master' into lan 2020-06-13 18:04:20 -05:00
Kevin a401f49da3 fix index.html not being auto loaded in subdirs
fix pep8 styling in sitefiles.py
2020-06-13 17:51:09 -05:00
Kevin 3d0f1d9337 fix import format in sitecreator init 2020-06-13 17:50:37 -05:00
Kevin 2a65f605f5 fix site creator not working with full paths by using a temporary chdir
fix grammar issue in site creator
2020-06-13 17:49:16 -05:00
Kevin Froman 7c5359c39e added colors.py 2020-06-09 21:05:33 -05:00
Kevin Froman 026901ce90 Fix gettransports 2020-04-14 22:40:31 -05:00
Kevin Froman a52465a54f work on lan 2020-04-06 08:51:20 -05:00
Kevin Froman d13d9a3039 added is_friend test for onionrusers and fixed bug where isFriend was setting instead of getting the value 2020-04-05 23:35:03 -05:00
Kevin Froman aa729d862c added escape_ansi unittest 2020-04-04 02:21:28 -05:00
Kevin Froman d47c546620 added dns rebinding runtime test 2020-04-03 23:34:23 -05:00
Kevin Froman 39d0be32ac import jsondecodeerror seperately since its not in ujson 2020-04-03 04:33:30 -05:00
Kevin Froman a8ab5d20f1 moving onionrutils over to ujson 2020-04-03 04:20:55 -05:00
Kevin Froman 37913d544b fixed localcommand formatting and imports 2020-04-03 04:19:20 -05:00
Kevin Froman eea8b39b0f refactored onionrusers formatting and json 2020-04-03 04:17:45 -05:00
Kevin Froman dee5d8ceed make config use ujson
made httpapi use ujson

made onionrblocks mod use ujson

made setup config use ujson

made devreporting use ujson

made transports/tor use ujson

made contactmanager use ujson
2020-04-03 04:13:50 -05:00
Kevin Froman b23343e7cb use ujson in serializeddata 2020-04-03 03:51:31 -05:00
Kevin Froman 8804c13225 * refactored subprocess and made it 20%+ faster by using ujson
+ added watchdog dep for sneakernet
+ added ujson dep for faster json esp in pow
2020-04-03 03:28:48 -05:00
Kevin Froman 8d372cccfb added stats reporter 2020-03-31 04:00:48 -05:00
Kevin Froman 0da27a78c7 basic requests can now use lan, work on lan client 2020-03-31 01:48:20 -05:00
Kevin Froman b2f630e4f9 added disk ministry 2020-03-31 00:15:24 -05:00
Kevin Froman 09134eaba4 comment sneakernet 2020-03-30 21:14:48 -05:00
Kevin Froman 1bd0aa9419 added sneakernet auto importing
exportblocks now takes argument
2020-03-30 20:52:04 -05:00
Kevin Froman d50e6db1d2 fix removeblock docstring 2020-03-27 20:03:30 -05:00
Kevin Froman 012ee33499 corrected onionrstorage formatting 2020-03-26 03:57:54 -05:00
Kevin Froman b8a8cfd3f6 changed socket_server config key to more accurate ephemeral_tunnels key 2020-03-26 03:49:23 -05:00
Kevin Froman 62b4f5eb0e Removed support for v2 onions 2020-03-26 03:48:57 -05:00
Kevin Froman db9cd3eb60 remove defunct import in register_private_blueprints.py 2020-03-26 02:33:08 -05:00
Kevin Froman d24fd41c53 added fd and disk usage stats 2020-03-24 03:18:05 -05:00
Kevin Froman 1be08e09ef reformated sizeutils 2020-03-24 03:17:22 -05:00
Kevin Froman 2aa8cdbaa0 corrected utils formatting and removed defunct utils 2020-03-23 23:55:57 -05:00
Kevin Froman b5e57da191 lan can now properly connect 2020-03-23 03:39:57 -05:00
Kevin Froman 2c8f1fdf99 restore unicoding in multicast ad 2020-03-23 01:25:27 -05:00
Kevin Froman eec7efd38d use right multicast address 2020-03-23 01:24:13 -05:00
Kevin Froman d77f802fdd lan client thread added 2020-03-23 00:37:49 -05:00
Kevin Froman acabeab7c4 added files for vdf proofing 2020-03-22 19:16:26 -05:00
Kevin Froman 9369a22841 correct updateblockinfo docstring and format 2020-03-22 19:16:08 -05:00
Kevin Froman 481cb5aeff use a smaller offset for obscuring block metadb time 2020-03-21 01:15:07 -05:00
Kevin Froman 4696e7be3f added offset test for lan block list and improved run time tests to be random order and have better iterative output 2020-03-21 01:14:35 -05:00
Kevin Froman 2a104d7459 added ram stats 2020-03-20 18:39:26 -05:00
Kevin Froman a52a17ac25 removed thread debug from events 2020-03-20 18:39:08 -05:00
Kevin Froman 3e4a39016f work on lan server (upload endpoint) 2020-03-20 03:51:08 -05:00
Kevin Froman e6181bdd1f fixed nasty bug where tor circuits was causing gevent to leak threads 2020-03-20 03:50:48 -05:00
Kevin Froman 022fbaa1af bumped disk allocation to 1gb 2020-03-20 03:47:08 -05:00
Kevin Froman b5ac1ed7d8 correct timer thread amounts 2020-03-20 03:45:25 -05:00
Kevin Froman fe3b6c01c4 * Remove ifaddr since psutil provides access to net interfaces
+ added mimcvdf dependency for future block spec
2020-03-19 16:02:15 -05:00
Kevin Froman d4f4487fb6 finished block list endpoint for lan and added get data endpoint 2020-03-19 01:44:44 -05:00
Kevin Froman e90d7e96f4 moved daemon kill command to its own seperate file in daemonlaunch 2020-03-19 01:43:57 -05:00
Kevin Froman 6fed37a237 reduced sleep in housekeeping run test 2020-03-19 01:43:02 -05:00
Kevin Froman 69bb257166 made ownnode run test only run if tor is enabled 2020-03-19 01:42:15 -05:00
Kevin Froman 24284e058f ensure public api served blocks are not decrypted 2020-03-19 01:40:52 -05:00
Kevin Froman 68678177ed type hinted bytesconverter 2020-03-16 02:55:36 -05:00
Kevin Froman 9575352e3e added config option for using LAN transport 2020-03-16 02:51:47 -05:00
Kevin Froman 3aec35ef33 * lan server including discovery and publishing added (only ping implemented in server) 2020-03-16 02:28:41 -05:00
Kevin Froman 92c4109572 * updated big brother to allow multicast and LAN 2020-03-16 02:06:37 -05:00
Kevin Froman 18aca5aeea finishd tests for multicast lan service discovery 2020-03-14 00:56:10 -05:00
Kevin Froman d4652e1107 added test for learning lan services 2020-03-13 23:47:44 -05:00
Kevin Froman 7bb95c3b87 work on lan transport, added service discovery logic 2020-03-11 04:46:42 -05:00
Kevin Froman a8290e2ac3 added cleanup test and test-re-runner automation script 2020-03-09 21:43:18 -05:00
Kevin Froman e4d4091e66 fixed pep8 formatting in daemon launch 2020-03-09 04:13:37 -05:00
Kevin Froman c106d5881f removed imports in daemon launch 2020-03-09 04:13:13 -05:00
Kevin Froman 25766e02fc Fixed epoch formatting 2020-03-09 04:05:10 -05:00
Kevin Froman a5c733469f made better sleep ignored sleep and added test for it 2020-03-09 04:04:41 -05:00
Kevin Froman 04133035ba fix existing tor daemon not having closed ephemeral onions and work on mail test 2020-03-07 18:51:39 -06:00
Kevin Froman 60d2ebfaed + added more tests
* fixed chdir home bug
* fixed some tests creating normal data dir
2020-03-04 01:15:58 -06:00
Kevin Froman 665cb0c732 fixed housekeeping being broken 2020-03-03 05:55:50 -06:00
Kevin Froman 02fa6dd558 added first browser test, tests if circles opens out of ot the box 2020-02-28 03:49:30 -06:00
Kevin Froman b62e613e8e work on mail settings, onionruser own key adding bug fix 2020-02-27 21:06:28 -06:00
Kevin Froman 862c6f2ea4 work on mail settings 2020-02-25 20:30:04 -06:00
Kevin Froman 6f0ef390a7 work on mail settings 2020-02-24 04:45:29 -06:00
Kevin Froman 56e86460d1 more vanityonionr changes 2020-02-23 02:12:30 -06:00
Kevin Froman b8348be65a now avoid looking up older than allowed blocks 2020-02-23 02:12:13 -06:00
Kevin Froman 34a55f63f9 fixed vanity not working and added integration test for it 2020-02-22 05:44:21 -06:00
Kevin Froman 080933639c fixed 'is onionr client' security exit attribute error and improved public security module formatting 2020-02-19 18:02:20 -06:00
Kevin Froman 9f1790a601 Added mail message padding support 2020-02-19 01:57:56 -06:00
Kevin Froman 83ef9dc3ca added sound notifications (used in mail for now) and more settings UI work 2020-02-18 05:32:17 -06:00
Kevin Froman aea4815fbd added sound notification support and forward secery setting finished 2020-02-17 06:13:57 -06:00
Kevin Froman 23782dcb8f work on mail settings 2020-02-12 05:31:05 -06:00
Kevin Froman 47eef04643 fix #45 2020-02-12 01:19:59 -06:00
Kevin Froman d149f351d2 made onionr ascii image default, added quotes to startup 2020-02-12 00:58:15 -06:00
Kevin Froman 59a1ad1235 move tor start finished message to bottom during merge from work on fixing onboarding 2020-02-11 20:10:21 -06:00
Kevin Froman 353b2f1c63 + added check for Tor to be ready before openhome works
* fixed not being able to stop Onionr when awaiting onboarding survey to be finished
2020-02-11 19:49:44 -06:00
Kevin Froman 3bb51a16e1 check for onionr exit when awaiting onboarding completion 2020-02-11 16:47:30 -06:00
Kevin Froman 26ddee54ce work on mail settings 2020-02-10 08:01:49 -06:00
Kevin Froman dee531fd51 added license info to boxprint 2020-02-08 17:07:39 -06:00
Kevin Froman 982ac88a72 print tor startup progress to term 2020-02-08 04:24:19 -06:00
Kevin Froman 572e29f5d5 bumped network version and main version, lots of test work and some stability improvements 2020-02-08 03:34:11 -06:00
Kevin Froman e77d422fc2 fix main init formatting 2020-02-06 16:00:19 -06:00
Kevin Froman b8c288259b fix keymanager formatting 2020-02-06 16:00:06 -06:00
Kevin Froman 2319ff8344 added config option to shred log file on exit 2020-02-06 04:11:39 -06:00
Kevin Froman 7c7e5de091 do not allow restart on windows 2020-02-06 00:54:49 -06:00
Kevin Froman 3456fae533 added site lister 2020-02-05 01:49:24 -06:00
Kevin Froman c8f0427f45 make data dir readable only by user by default, make no dep release 2020-02-04 18:07:03 -06:00
Kevin Froman b305380447 protect data dir by default 2020-02-04 16:58:24 -06:00
Kevin Froman d91480104b handle more sec levels in ui stats 2020-02-04 15:42:08 -06:00
Kevin Froman 52e3600ae1 bump version 2020-02-04 14:55:56 -06:00
Kevin Froman fe36b87c57 fix notifier formatting 2020-02-04 14:18:20 -06:00
Kevin Froman 8e1eaa2b42 updated readme 2020-02-04 00:59:52 -06:00
Kevin Froman b86eb821ce clean up onboarding handler 2020-02-03 21:49:21 -06:00
Kevin Froman 68074d4dd8 moving to release with better settings and onboarding 2020-02-03 20:08:06 -06:00
Kevin Froman 246ba6eb7b fixed onboarding bugs and enabled it by default 2020-02-03 17:01:08 -06:00
Kevin Froman 6500229000 added attack simulation scripts 2020-02-02 21:21:51 -06:00
Kevin Froman c58bbbb10f Add missing import in daemon launch 2020-02-02 19:16:30 -06:00
Kevin Froman d4dd964069 don't restart tor unless its our own 2020-02-02 19:07:48 -06:00
Kevin Froman 5b78a8810d only nuke data on node shutdown 2020-02-02 19:00:49 -06:00
Kevin Froman 8a82e76182 fix tor dir being too open 2020-02-02 03:23:59 -06:00
Kevin Froman 8e5152a14e added support to wipe data directory on exit 2020-02-02 02:48:23 -06:00
Kevin Froman 567af997d7 Added dev config scripts 2020-02-02 00:55:39 -06:00
Kevin Froman 88146a5690 use thread instead of greenlet to start run time tests 2020-01-31 22:57:53 -06:00
Kevin Froman cd671feb92 tor can now be attached 2020-01-31 22:14:26 -06:00
Kevin Froman ea47ae456b work on the ability to attach to existing Tor 2020-01-31 18:23:48 -06:00
Kevin Froman 840563f75c work on the ability to attach to existing Tor 2020-01-31 07:35:44 -06:00
Kevin Froman bffef46e89 Added boilerplate to gettransports 2020-01-31 07:35:44 -06:00
Kevin Froman d0bdeca7c4 fixed hide blocks being broken in some cases 2020-01-30 00:54:43 -06:00
Kevin Froman 8649231860 fix cmd recommend to use f string 2020-01-29 23:22:23 -06:00
Kevin Froman 8a3f84097a + now require runtime tests to generate unittest result that is somewhat fresh
+ add runtime test for webpass needing to be set
2020-01-29 22:56:47 -06:00
Kevin Froman 6624a80c68 remove signed stats from stats command 2020-01-29 20:20:02 -06:00
Kevin Froman 2bc14b5c63 add gzip to exec bigbrother for sites and fix passphase print in site creator 2020-01-29 15:44:44 -06:00
Kevin Froman a958b99fef remove sent mail from sentbox when block is blacklisted 2020-01-29 13:48:45 -06:00
Kevin Froman c636e87b2c improve formatting in removeblock and blacklist 2020-01-29 13:48:45 -06:00
Kevin Froman 2732c3a149 reenable client security (OOPS) 2020-01-29 13:45:31 -06:00
Kevin Froman 0059c91b06 use fp symbol instead, merge master changes before merging back to improve circles 2020-01-28 00:29:20 -06:00
Kevin Froman 2bc996f660 supress gevent error from sses 2020-01-27 23:52:35 -06:00
Kevin Froman a1fd5f2648 remove defunct test, add random bint ip test, and fix offline mode 2020-01-27 19:32:25 -06:00
Kevin Froman ef25377e15 improved formatting in miscclient endpoints 2020-01-27 17:30:22 -06:00
Kevin Froman 11d97a12d0 give stats module more specific name 2020-01-27 02:20:09 -06:00
Kevin Froman b1a7641db9 removed defunct communicator methods 2020-01-27 02:09:28 -06:00
Kevin Froman 5c636246fb added tor circuit stats to main page 2020-01-25 02:23:18 -06:00
Kevin Froman 57f233d856 added work on new main page with tor statistics. Added TorStats class to access tor statistics suck as circuit information 2020-01-21 02:36:19 -06:00
Kevin Froman dd0ebd9238 add forgotten blocknoncestart file 2020-01-19 21:55:58 -06:00
Kevin Froman 07ab85698d raise exceptions instead of false return in blockimporter 2020-01-19 21:10:51 -06:00
Kevin Froman 3aeb305994 disable pool for mixing and announce node sooner after start 2020-01-19 21:10:01 -06:00
Kevin Froman c7bbd054e4 make deniable blocks larger on average 2020-01-19 21:06:22 -06:00
Kevin Froman 4afa3d87e5 delete disk usage file after soft reset 2020-01-19 21:05:55 -06:00
Kevin Froman f3b22dad56 remove DataPOW and make POW use non hard coded start int value 2020-01-19 21:02:51 -06:00
Kevin Froman 7db8193bf6 remove POW for annoncements 2020-01-19 21:02:04 -06:00
Kevin Froman 1c6893e297 fix variable misspelling when clearing wait for share session 2020-01-15 00:26:10 -06:00
Kevin Froman 828f7682b8 added server sent events wrapper and example 2020-01-14 02:29:42 -06:00
Kevin Froman 29421d678e KISS startup delete plaintext blocks based on config, no blacklist 2020-01-10 03:42:04 -06:00
Kevin Froman f78809fa2a added config observers, delete plaintext blocks when plaintext storage is disabled 2020-01-07 05:44:53 -06:00
Kevin Froman 2e31155a5d fix insert queue removal not using json mode 2020-01-06 18:40:44 -06:00
Kevin Froman 27ef1d9ce4 remove never added daemon event function from pluginapi 2020-01-06 18:26:31 -06:00
Kevin Froman 88fe605762 finish up removing daemon queue, migrate shutdown to event system 2020-01-06 18:25:51 -06:00
Kevin Froman a801960179 moved all but shutdown over to new daemon events system 2020-01-06 06:09:33 -06:00
Kevin Froman c975d27906 switched to upload event api 2020-01-04 06:13:10 -06:00
Kevin Froman 1ba8b4c707 * fleshed out daemon events; also is now used for insertion queue removal
* deprecated daemon queue and removed unused daemon queue commands
2020-01-03 04:26:36 -06:00
Kevin Froman 6529d3e622 json mode added to local command 2020-01-03 04:15:20 -06:00
Kevin Froman d7be2ca16d delete upload memory file file on shutdown if upload queue is empty 2020-01-03 04:14:04 -06:00
Kevin Froman ee7b68c844 added new daemon events files 2020-01-01 20:07:34 -06:00
Kevin Froman 66aafb6deb added new daemon events work 2019-12-30 18:57:14 -06:00
Kevin Froman e9f0e60608 added toggle bootstrap command 2019-12-29 11:21:18 -06:00
Kevin Froman 01f9b9b470 work on block insertion mixing 2019-12-27 01:53:18 -06:00
Kevin Froman 87ea8d137b minor bug fixes and linting improvements 2019-12-23 01:51:24 -06:00
Kevin Froman 9329b07e3b added mixmate to improve base routing 2019-12-22 13:42:10 -06:00
Kevin Froman f71f2f6246 fix env home regression and made identifyhome lint compliant 2019-12-20 15:50:56 -06:00
Kevin Froman c469c5d871 made communicator init have better lint compliance 2019-12-20 02:59:27 -06:00
Kevin Froman b5a8f295c9 made uploadqueue lint compliant 2019-12-20 02:43:18 -06:00
Kevin Froman 1019ff0773 * made api servers lint compliant
* made bigbrother lint compliant
2019-12-20 02:37:12 -06:00
Kevin Froman 9571ea519d identify home better supports env home in non daemon 2019-12-20 02:33:42 -06:00
Kevin Froman e5f3866f9e linting refactoring communicator(utils) and reduced TOCTOU issus with online peer picking 2019-12-20 01:24:38 -06:00
Kevin Froman 9fbee668aa fix regression exposing socks port to daemon instead of api server 2019-12-20 01:21:43 -06:00
Kevin Froman eb294dd9ae fix big brother docstrings and disable_hooks default arg 2019-12-19 23:28:12 -06:00
Kevin Froman 0484655e2e fix ofexec not properly checking for windows for tor kill os.system 2019-12-19 23:26:29 -06:00
Kevin Froman f5a98fba13 fix ofexec auditor docstrings 2019-12-19 23:22:51 -06:00
Kevin Froman 906219fe30 * Refactored onionrcommands py to be linting compliant (started using mypy)
+ git ignore mypy cache
2019-12-19 20:46:11 -06:00
Kevin Froman 6d123b93fc made parser flake8 compliant 2019-12-19 04:32:40 -06:00
Kevin Froman e77e213589 made keyadders pep8 compliant 2019-12-19 03:13:41 -06:00
Kevin Froman 027abd3f13 None is not a type 2019-12-18 04:13:38 -06:00
Kevin Froman c1dd2a7213 flake8 log style for connect fails 2019-12-18 04:10:00 -06:00
Kevin Froman 00e20c54b0 don't try to connect to peers in offline mode 2019-12-18 04:09:37 -06:00
Kevin Froman f7e2a94502 flake8 refactors get onlinePeers 2019-12-18 04:08:33 -06:00
Kevin Froman 9707d5e320 fix flake8 ofcommunication line len 2019-12-18 04:07:20 -06:00