spider.git
3 years agoadd an RBN line to progress newusers
Dirk Koopman [Thu, 28 May 2020 20:35:34 +0000 (21:35 +0100)]
add an RBN line to progress

3 years agoadd new colour for RBN in console
Dirk Koopman [Wed, 27 May 2020 23:43:43 +0000 (00:43 +0100)]
add new colour for RBN in console

3 years agoRBN now with basic spots
Dirk Koopman [Wed, 27 May 2020 23:35:42 +0000 (00:35 +0100)]
RBN now with basic spots

3 years agonew dbgtrace command
Dirk Koopman [Wed, 27 May 2020 20:45:00 +0000 (21:45 +0100)]
new dbgtrace command

Avoid the use of Carp long/short_message and replace it with our own.

3 years agofix the issue in DXProt::add_thingy
Dirk Koopman [Tue, 26 May 2020 18:53:13 +0000 (19:53 +0100)]
fix the issue in DXProt::add_thingy

For some reason I wasn't checking whether PC92 routing message was valid
enough. I shall probably have to harden it even more still.

Also fixed DXDebug::printdbgring(nn) so that actually honours nn!

3 years agoWIP RBN
Dirk Koopman [Tue, 26 May 2020 08:18:46 +0000 (09:18 +0100)]
WIP RBN

3 years agoadd connect time/uptime for links cmd
Dirk Koopman [Tue, 26 May 2020 08:18:01 +0000 (09:18 +0100)]
add connect time/uptime for links cmd

3 years agofix DXSubcommand thaw protection
Dirk Koopman [Sat, 23 May 2020 15:30:36 +0000 (16:30 +0100)]
fix DXSubcommand thaw protection

3 years agolimit the no of spots stored for a search
Dirk Koopman [Sat, 23 May 2020 17:37:49 +0000 (18:37 +0100)]
limit the no of spots stored for a search

This is to cope with people that suck skimmer spots and end up
with 100Mb files to read. But it does rely on the hint getting
most of the candidates with not more than 2 false positives.

3 years agotry to fix DXSubprocess errors
Dirk Koopman [Sat, 23 May 2020 13:51:09 +0000 (14:51 +0100)]
try to fix DXSubprocess errors

That are happening at the EA3CV-2.
Also make sure that an incoming connection's IP address is recorded.

3 years agoremove some blank lines
Dirk Koopman [Sat, 23 May 2020 13:50:45 +0000 (14:50 +0100)]
remove some blank lines

3 years agofix spawn_cmd in Cron so anyone can use it
Dirk Koopman [Thu, 21 May 2020 16:47:33 +0000 (17:47 +0100)]
fix spawn_cmd in Cron so anyone can use it

3 years agoadd missing saveuserfile and expm spawn_cmd cmds
Dirk Koopman [Thu, 21 May 2020 16:30:23 +0000 (17:30 +0100)]
add missing saveuserfile and expm spawn_cmd cmds

3 years agofix call/call-ssid locking issue
Dirk Koopman [Thu, 21 May 2020 15:32:30 +0000 (16:32 +0100)]
fix call/call-ssid locking issue

Fix the situation where GB7DXC exists and is locked out and $allowmultiple
is active than GB7DXC-5 logs in and is locked by dint of GB7DXC's locked
status and ignores GB7DXC-5's unlocked status.

Run convert-users-v3-to-v4.pl automatically if there are no users.v4[.o/.n]
files present in local_data or data. Then copy users.v4 to users.v4,n and
do an export_users, creating users_json.

File user export so that it actually works!

3 years agofix allowmultiple for real user with ssid
Dirk Koopman [Thu, 21 May 2020 13:23:55 +0000 (14:23 +0100)]
fix allowmultiple for real user with ssid

and put back the missing code in DXUser::close to record login
times which allow multiple users to work in the first place!

3 years agoadd CTY-3010 prefixes
Dirk Koopman [Wed, 20 May 2020 17:40:55 +0000 (18:40 +0100)]
add CTY-3010 prefixes

3 years agoreplace Storable->JSON in QSL.pm.
Dirk Koopman [Wed, 20 May 2020 17:29:40 +0000 (18:29 +0100)]
replace Storable->JSON in QSL.pm.

Rename qsl.v1 -> dxsql.v2 and create_qsl.pl -> create_dxqsl.pl

3 years agoadd gitbranch to pc18
Dirk Koopman [Wed, 20 May 2020 15:27:11 +0000 (16:27 +0100)]
add gitbranch to pc18

3 years agobelt and braces locate users.v4 in DXUser.pm
Dirk Koopman [Wed, 20 May 2020 14:59:58 +0000 (15:59 +0100)]
belt and braces locate users.v4 in DXUser.pm

3 years agocorrect convert-users-v3-to-v4.pl
Dirk Koopman [Wed, 20 May 2020 14:20:25 +0000 (15:20 +0100)]
correct convert-users-v3-to-v4.pl

3 years agoadd important stuff to UPGRADE.mojo
Dirk Koopman [Wed, 20 May 2020 13:02:54 +0000 (14:02 +0100)]
add important stuff to UPGRADE.mojo

3 years agocorrect users conversion program name
Dirk Koopman [Wed, 20 May 2020 12:30:07 +0000 (13:30 +0100)]
correct users conversion program name

3 years agostrip out user conversion into convert-v3-to-v4.pl
Dirk Koopman [Wed, 20 May 2020 12:18:03 +0000 (13:18 +0100)]
strip out user conversion into convert-v3-to-v4.pl

3 years agoadd branch to sh/ver, rm redundant module
Dirk Koopman [Tue, 19 May 2020 15:55:03 +0000 (16:55 +0100)]
add branch to sh/ver, rm redundant module

3 years agoFix all the DXUser API changes to use JSON
Dirk Koopman [Tue, 19 May 2020 15:07:12 +0000 (16:07 +0100)]
Fix all the DXUser API changes to use JSON

3 years agonew style DXUsers memory layout
Dirk Koopman [Mon, 18 May 2020 22:44:05 +0000 (23:44 +0100)]
new style DXUsers memory layout

This allows for the unused user records to stay out of RAM until
"get"ed (or got in English). New get calls that allow for listing
to be done with auto-vivifying user records in the main hash.

Also partial lists can be obtained with get_some_calls(qr/.../).

3 years agochange system crontab to spawn export_users
Dirk Koopman [Fri, 15 May 2020 23:31:38 +0000 (00:31 +0100)]
change system crontab to spawn export_users

3 years agofix export_user cmd for now
Dirk Koopman [Fri, 15 May 2020 23:24:41 +0000 (00:24 +0100)]
fix export_user cmd for now

3 years agoWIP DXUser no storable, no db_file
Dirk Koopman [Fri, 15 May 2020 23:09:19 +0000 (00:09 +0100)]
WIP DXUser no storable, no db_file

3 years agoMerge branch 'newusers' of ssh://server/scm/spider into newusers
Dirk Koopman [Fri, 15 May 2020 15:58:36 +0000 (16:58 +0100)]
Merge branch 'newusers' of ssh://server/scm/spider into newusers

3 years agoNow add files that the previous commit refered to
Dirk Koopman [Fri, 15 May 2020 15:56:32 +0000 (16:56 +0100)]
Now add files that the previous commit refered to

3 years agovarious (hopeful) stability changes
Dirk Koopman [Fri, 15 May 2020 15:52:03 +0000 (16:52 +0100)]
various (hopeful) stability changes

1. Remove Storable from subprocessing, introduce DXSubcommand as
   a light shim over Mojo::IOLoop::Subprocess.
2. Try to prevent user->put when in a spawned process. Which will
   likely need more thinking about and more work.
3. Make it clearer where the spawns are coming from.

3 years agofix error messaging in DXUser::init
Dirk Koopman [Wed, 13 May 2020 10:40:29 +0000 (12:40 +0200)]
fix error messaging in DXUser::init

3 years agonominally working JSON Storable DXUser replacement
Dirk Koopman [Wed, 13 May 2020 00:35:22 +0000 (01:35 +0100)]
nominally working JSON Storable DXUser replacement

works more than three times as fast as Storable does and, hopefully
is less likely to get corrupted.

3 years agoMerge branch 'mojo' into newusers
Dirk Koopman [Tue, 12 May 2020 22:59:36 +0000 (23:59 +0100)]
Merge branch 'mojo' into newusers

3 years agoRestore Script.pm to master's version
Dirk Koopman [Tue, 12 May 2020 22:26:37 +0000 (23:26 +0100)]
Restore Script.pm to master's version

3 years agoupdated docs for rbn.pl
Dirk Koopman [Tue, 12 May 2020 21:42:28 +0000 (22:42 +0100)]
updated docs for rbn.pl

3 years agoprobably fix Script erase error
Dirk Koopman [Mon, 11 May 2020 18:05:37 +0000 (19:05 +0100)]
probably fix Script erase error

3 years agoprobably fix Script erase error
Dirk Koopman [Mon, 11 May 2020 18:05:37 +0000 (19:05 +0100)]
probably fix Script erase error

3 years agofix typos in DXUser.pm
Dirk Koopman [Mon, 11 May 2020 11:26:09 +0000 (12:26 +0100)]
fix typos in DXUser.pm

3 years agoadd first part of json users file change
Dirk Koopman [Mon, 11 May 2020 08:12:41 +0000 (09:12 +0100)]
add first part of json users file change

3 years agoimprove node initialisation debugging multiconnect
Dirk Koopman [Sun, 10 May 2020 23:30:28 +0000 (00:30 +0100)]
improve node initialisation debugging

3 years agofix echo typo
Dirk Koopman [Sun, 10 May 2020 22:51:12 +0000 (23:51 +0100)]
fix echo typo

3 years agoInitial user multiple attachments!!
Dirk Koopman [Sun, 10 May 2020 22:42:22 +0000 (23:42 +0100)]
Initial user multiple attachments!!

This will, after 3 (default) bumpoffs with 5 mins (default) it
will allow up $main::allowmultiple (if set > 1) connections with different
ssids BUT THE SAME user record.

Strip out echo and blank cmds from progress debugging unless set/debug 'echo'
is set.

3 years agowwv & wcy progress, random lockouts
Dirk Koopman [Sat, 9 May 2020 21:23:45 +0000 (22:23 +0100)]
wwv & wcy progress, random lockouts

Improve the look of WWV and WCY progress messages.
Stop the random lockouts of connected nodes with ephemeral user
records.

3 years agoadd incoming route/channel for progress dbg
Dirk Koopman [Sat, 9 May 2020 16:45:05 +0000 (17:45 +0100)]
add incoming route/channel for progress dbg

3 years agosquash some warnings
Dirk Koopman [Fri, 8 May 2020 15:26:05 +0000 (16:26 +0100)]
squash some warnings

3 years agotidy up Route, add argument to sh/ver
Dirk Koopman [Fri, 8 May 2020 15:06:53 +0000 (16:06 +0100)]
tidy up Route, add argument to sh/ver

3 years agoremove day/month/year from progress spots
Dirk Koopman [Thu, 7 May 2020 16:31:45 +0000 (17:31 +0100)]
remove day/month/year from progress spots

3 years agoadd reversion statement to Changes
Dirk Koopman [Thu, 7 May 2020 15:46:31 +0000 (16:46 +0100)]
add reversion statement to Changes

3 years agoredo ffff remove on pc92 a
Dirk Koopman [Thu, 7 May 2020 15:41:57 +0000 (16:41 +0100)]
redo ffff remove on pc92 a

3 years agoRevert "add first take on IP address remembering"
Dirk Koopman [Thu, 7 May 2020 15:31:27 +0000 (16:31 +0100)]
Revert "add first take on IP address remembering"

This reverts commit c7a3cfda9336d765d387e9328f817d1f0e5230d1.

3 years agoRevert "new version of ip address storage"
Dirk Koopman [Thu, 7 May 2020 15:12:06 +0000 (16:12 +0100)]
Revert "new version of ip address storage"

This reverts commit f18ba64dd93bbf7c47e6b5143bfc99af817888e8.

3 years agoadd expanded UPGRADE.mojo
Dirk Koopman [Tue, 28 Apr 2020 13:20:31 +0000 (14:20 +0100)]
add expanded UPGRADE.mojo

3 years agonew version of ip address storage
Dirk Koopman [Mon, 27 Apr 2020 23:38:11 +0000 (00:38 +0100)]
new version of ip address storage

3 years agostrip off extra brackets in pc61 ip storage
Dirk Koopman [Mon, 27 Apr 2020 18:47:30 +0000 (19:47 +0100)]
strip off extra brackets in pc61 ip storage

3 years agotry to fix the recursive brackets on PC61 ip
Dirk Koopman [Mon, 27 Apr 2020 18:32:39 +0000 (19:32 +0100)]
try to fix the recursive brackets on PC61 ip

3 years agoadd first take on IP address remembering
Dirk Koopman [Mon, 27 Apr 2020 15:48:08 +0000 (16:48 +0100)]
add first take on IP address remembering

3 years agoadd line more debugging to DXCron::cread
Dirk Koopman [Sun, 26 Apr 2020 23:52:33 +0000 (00:52 +0100)]
add line more debugging to DXCron::cread

3 years agolose some of the annoying uninitialised msgs
Dirk Koopman [Sun, 26 Apr 2020 23:38:48 +0000 (00:38 +0100)]
lose some of the annoying uninitialised msgs

3 years agoBe even more paranoid decoding users
Dirk Koopman [Sun, 26 Apr 2020 13:33:40 +0000 (14:33 +0100)]
Be even more paranoid decoding users

3 years agofix DXUtil::localdata ?perl bug?
Dirk Koopman [Sun, 26 Apr 2020 13:02:48 +0000 (14:02 +0100)]
fix DXUtil::localdata ?perl bug?

3 years agofix localdata for /spider/data only files
Dirk Koopman [Sun, 26 Apr 2020 12:42:03 +0000 (13:42 +0100)]
fix localdata for /spider/data only files

3 years agofix export_users cmd
Dirk Koopman [Sun, 26 Apr 2020 12:31:50 +0000 (13:31 +0100)]
fix export_users cmd

Actually make sure that DXUser::del_file removes all versions
of users.v3 it can find whether in /spider/data and in /spider/local_data.

In the process make sure that the DEFAULT place that "localdata(<file>)
places that <file> is in /spider/local_data.

3 years agoyet another sh/cl change
Dirk Koopman [Sun, 26 Apr 2020 11:24:15 +0000 (12:24 +0100)]
yet another sh/cl change

3 years agoyet another sh/cl
Dirk Koopman [Sun, 26 Apr 2020 11:01:52 +0000 (12:01 +0100)]
yet another sh/cl

3 years agoremove redundant CMD debugging
Dirk Koopman [Sun, 26 Apr 2020 10:47:48 +0000 (11:47 +0100)]
remove redundant CMD debugging

3 years agofix dbg warnings on things like $main::me->run_cmd
Dirk Koopman [Sun, 26 Apr 2020 10:43:43 +0000 (11:43 +0100)]
fix dbg warnings on things like $main::me->run_cmd

3 years agoadd vestigial WWV and WCY 'progress'
Dirk Koopman [Sun, 26 Apr 2020 09:58:23 +0000 (10:58 +0100)]
add vestigial WWV and WCY 'progress'

These are not in their final form. Please don't give me a hard time about
that.

Changed sh/cl message again.

3 years agofix sh/cl at user startup with new arrangements
Dirk Koopman [Sat, 25 Apr 2020 23:01:23 +0000 (00:01 +0100)]
fix sh/cl at user startup with new arrangements

3 years agoremove redundant wpxloc.dat
Dirk Koopman [Sat, 25 Apr 2020 22:50:40 +0000 (23:50 +0100)]
remove redundant wpxloc.dat

3 years agosh/cl and dmesg changes
Dirk Koopman [Sat, 25 Apr 2020 22:33:09 +0000 (23:33 +0100)]
sh/cl and dmesg changes

Add max no of local users seen since node start
Add ability to show last n lines of the debug ring buffer

3 years agofix weird sprintf error in AnnTalk dbging
Dirk Koopman [Fri, 24 Apr 2020 23:54:22 +0000 (00:54 +0100)]
fix weird sprintf error in AnnTalk dbging

Specifically:

Invalid conversion in sprintf: "% -35 " at /spider/perl/DXProtHandle.pm line 2016.

3 years agodo some ring printing if carp et al are called
Dirk Koopman [Fri, 24 Apr 2020 23:47:02 +0000 (00:47 +0100)]
do some ring printing if carp et al are called

3 years agoadd link to show/debug_ring as dmesg
Dirk Koopman [Fri, 24 Apr 2020 19:54:06 +0000 (20:54 +0100)]
add link to show/debug_ring as dmesg

Should be a reasonable synonym for linux people. And it's a lot quicker
to type than show/debug_ring. Which is, admittedly, more descriptive.

4 years agoadd "progress" to pc93 messages
Dirk Koopman [Fri, 24 Apr 2020 12:52:14 +0000 (13:52 +0100)]
add "progress" to pc93 messages

4 years agofix default crontab
Dirk Koopman [Fri, 24 Apr 2020 12:13:45 +0000 (13:13 +0100)]
fix default crontab

4 years agochange spawn_cmd diffms msg to progress
Dirk Koopman [Fri, 24 Apr 2020 11:02:10 +0000 (12:02 +0100)]
change spawn_cmd diffms msg to progress

4 years agochanged the default DXVars.pm.issue debug
Dirk Koopman [Fri, 24 Apr 2020 10:52:56 +0000 (11:52 +0100)]
changed the default DXVars.pm.issue debug

4 years agochange DXCron subprocess stats to 'progress'
Dirk Koopman [Fri, 24 Apr 2020 10:05:50 +0000 (11:05 +0100)]
change DXCron subprocess stats to 'progress'

4 years agoadd arguments to CMD progress debug
Dirk Koopman [Fri, 24 Apr 2020 09:52:22 +0000 (10:52 +0100)]
add arguments to CMD progress debug

4 years agoadd CTY-3008 prefixes
Dirk Koopman [Fri, 24 Apr 2020 09:43:46 +0000 (10:43 +0100)]
add CTY-3008 prefixes

4 years agoadd progress indications
Dirk Koopman [Fri, 24 Apr 2020 09:32:42 +0000 (10:32 +0100)]
add progress indications

set/debug progress (now a default) will show signs of stuff happening
in concentrated form, e.g a new spot or someone using a command. This
is especially useful in 'nolog' (i,e "ring buffer") modes.

Fix grepdbg so that no input line just lists the latest dbg file

4 years agoadd unset/startup to the Changes list
Dirk Koopman [Wed, 22 Apr 2020 23:06:29 +0000 (00:06 +0100)]
add unset/startup to the Changes list

4 years agoFix unset/startup cmd
Dirk Koopman [Wed, 22 Apr 2020 23:03:08 +0000 (00:03 +0100)]
Fix unset/startup cmd

4 years agoadd prefixes CTY-3007
Dirk Koopman [Wed, 22 Apr 2020 20:07:49 +0000 (21:07 +0100)]
add prefixes CTY-3007

4 years agofix modules search path in update_sysop.pl
Dirk Koopman [Wed, 22 Apr 2020 17:43:28 +0000 (18:43 +0100)]
fix modules search path in update_sysop.pl

This means it will work even if not called from /spider/perl.

4 years agoadd Spot.pm with disabled $readback
Dirk Koopman [Tue, 21 Apr 2020 21:26:53 +0000 (22:26 +0100)]
add Spot.pm with disabled $readback

It turns out that using tac to read backwards isn't really worth it
for spot files, but I'm leaving the code there for any future
use cases.

4 years agosimplified the disconnect even more
Dirk Koopman [Tue, 21 Apr 2020 19:13:39 +0000 (20:13 +0100)]
simplified the disconnect even more

And now added some working debugging and put back bye.pl so that
it doesn't call Mojo directly.

Simplified the whole thing. Now let's see whether that has a memory leak

4 years agoRemove wait on drain (which may never happen)
Dirk Koopman [Tue, 21 Apr 2020 18:43:32 +0000 (19:43 +0100)]
Remove wait on drain (which may never happen)

Changed the arrangements sending logout files (what a palaver for
something so "simple"). Basically, if there is nothing to send on
disconnect, the Mojo "drain" signal is never emitted. So it hangs for
ever. But only sometimes (for some reason).

4 years agonote sh/log speedup changes
Dirk Koopman [Mon, 20 Apr 2020 17:57:15 +0000 (18:57 +0100)]
note sh/log speedup changes

4 years agofix sh/log things to allow all search strings
Dirk Koopman [Mon, 20 Apr 2020 13:55:13 +0000 (14:55 +0100)]
fix sh/log things to allow all search strings

Search strings are escaped so can't be regexes (but that could change)

4 years agofix sh/log users as well
Dirk Koopman [Mon, 20 Apr 2020 13:39:39 +0000 (14:39 +0100)]
fix sh/log users as well

4 years agospeed up sh/log et al by using 'tac' if found
Dirk Koopman [Mon, 20 Apr 2020 13:07:34 +0000 (14:07 +0100)]
speed up sh/log et al by using 'tac' if found

4 years agoadd info to Changes and UPGRADE.mojo
Dirk Koopman [Mon, 20 Apr 2020 00:22:27 +0000 (01:22 +0100)]
add info to Changes and UPGRADE.mojo

4 years agoremove any leading ::ffff: on ipv4 addresses newdisc
Dirk Koopman [Sun, 19 Apr 2020 22:44:00 +0000 (23:44 +0100)]
remove any leading ::ffff: on ipv4 addresses

4 years agoforce disconnect on attempt 2
Dirk Koopman [Sun, 19 Apr 2020 20:33:07 +0000 (21:33 +0100)]
force disconnect on attempt 2

4 years agoclean up Msg debugging further
Dirk Koopman [Sun, 19 Apr 2020 20:28:28 +0000 (21:28 +0100)]
clean up Msg debugging further

Also make sure that a FORCE CLOSE situation (which may now never happen)
goes directly to close it.

4 years agoadjust accept debugging a tad
Dirk Koopman [Sun, 19 Apr 2020 20:18:30 +0000 (21:18 +0100)]
adjust accept debugging a tad

4 years agofix hang on unreachable outgoing connects
Dirk Koopman [Sun, 19 Apr 2020 20:09:17 +0000 (21:09 +0100)]
fix hang on unreachable outgoing  connects