question

Kevin Windrem avatar image
Kevin Windrem asked

SetupHelper with Package Manager available

As of v4.13, PackageManager now backs up gui, SetupHelper and PackageManager log files to removable media in addition to SOME dbus Settings and custom logos.

Just finished the beta phase. v4.0 now released

This is a major rewrite to SetupHelper.

It uses menus in the Venus GUI to control automatic and manual downloads and installs, uninstalls.

You no longer need a command line to install my packages. Blind install SetupHelper, then use the menus for everything else.

Packages are auto discovered by their existence in /data, so if you have some packages already stored in /data, they should appear in the versions menu.

Default packages appear in Package Editor when Add Package is chosen.

Current version is available here:

https://github.com/kwindrem/SetupHelper/

just download venus-data.tgz and follow the blind install instructions in the ReadMe.


You can leave the branch set to beta to participate in the next beta phase, or change the branch to "latest" to stay on the latest released version. The beta tag will continue to point to the latest version whether it is a released or a beta version.

As always, please report any issues or if you have questions

Venus OSsetup
13 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

gainestr avatar image gainestr commented ·
Is there a way to set up Package Manager to backup to a compressed file within the /data folder so then I can transfer the archived data via SFTP instead of having to have local access to the USB drive. I think this would be a nice feature to be able to select an option of where the backup is stored.
1 Like 1 ·
Kevin Windrem avatar image Kevin Windrem gainestr commented ·
I think that can be done. I would not backup the logs to /data since they live there already.

setupOptions is also in /data already

custom logos are also in /data/themes/overlays so those would not need to be backed up either.

The settings backup file is pretty small without compressing (17 KB on my test system). So I think I can always write the settingsBackup file to /data somewhere, or only write it when removable media isn't present.

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem gainestr commented ·

I added commands to the Backup & restore settings Package Manager menu to store and restore to/from local media. The file /data/settingsBackup is created on backup which you can then access via FTP, rsync or whatever.

logos are already in /data/themes/overlays

logs are already in /data/logs

setup options are already in /data/setupOptions

So these can be easily accessed via your favorite transfer program.

0 Likes 0 ·
cray2023 avatar image cray2023 commented ·
CerboGX runing latest -20 firmware.

Tried blind install of package manager. The menu option shows up in the "settings" but it stated

"Package Manager not running"

I've rebooted several times, even uninstalled using the uninstall file then reinstalled. Still get not running.

Any ideas?

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem cray2023 commented ·
It's working OK for me on my Raspberry PI test system. Blind install checked too.

If you can get to the logs, the following files might help me debug your issue:

/data/logSetupHelper

/data/log/PackageManager/current

What version of SetupHelper are you using?

0 Likes 0 ·
cray2023 avatar image cray2023 Kevin Windrem commented ·

I'm using the newest thats linked in the github instructions. Attached logs

logs.zip

0 Likes 0 ·
logs.zip (10.4 KiB)
Kevin Windrem avatar image Kevin Windrem cray2023 commented ·

Thanks for the logs. I found the problem. Some folder in /data has a zero length file named "version". It also contains a file named "setup". I use these two files to identify a potential new package.

What I do not know is what the folder has the invalid version file.

I was not checking for a zero length version file before checking it's contents. That will be fixed in SetupHelper v4.36 which I'll post tomorrow after some additional testing.

You might look around in /data and see if you can find the offending directory that contains a version file with nothing in it (except maybe spaces).

0 Likes 0 ·
cray2023 avatar image cray2023 Kevin Windrem commented ·

I looked in the GuiMods folder that was in the data directory.

It had the blank version. I renamed that version file and almost instantly package manager started and had replaced the file with another.

But now GuiMods will not run. When I go to package manager, available packages, it shows the "github" version, "Stored version" but "installed is blank.

So I went back and renamed the GuiMods folder to GuiMods1. The GuiMods are running on the screen, but now package manager shows this screen shot.

screenshot-2023-02-26-at-61054-am.png

Am I ok to just delete all the GuiMods folders and have it try again? I must have had some wonky version of that. This CerboGX had previously used GuiMods back in 2.90 versions. It had been powered off through the winter. When it powered up it downloaded 3.0 and then things went haywire.


Thanks for all the help!

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem cray2023 commented ·

Go into the GuiMods1 package and uninstall it.

Then remove the package.

Do the same for GuiMods, although it will already be uninstalled.

Then, delete the GuiMods and GuiMods1 folders.

You should also remove /data/setupOptions/GuiMods1 and .../GuiMods folders.

Not sure why this happened. The system should have updated from a previous firmware and updated to the latest GuiMods version but it's possible something got interrupted during the process.

The GuiMods1 in the active packages list is because I look for folders in /data that might be a package that should be included in PackageManager. A better way would be to move GuiMods to something like /data/disabled/GuiMods then PackageManager won't see it (only looks one level deep in the directory tree).

0 Likes 0 ·
cray2023 avatar image cray2023 Kevin Windrem commented ·

OK I went to package manager. Uninstalled "GuiMods" but "GuiMods1" does not have that option.


I deleted all the GuiMods folders that were in "data"

Here is a screen shot, plus a screen shot showing whats in the "Data" directory. screenshot-2023-02-26-at-110142-am.pngscreenshot-2023-02-26-at-105937-am.png

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem cray2023 commented ·
Try Reinitialize PackageManager in the menu before Active packages
0 Likes 0 ·
cray2023 avatar image cray2023 Kevin Windrem commented ·
The reinitialize finally seems to have it all sorted. Thanks for the help!
0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem cray2023 commented ·
also rm -rf /data/setupOptions/GuiMods1
0 Likes 0 ·
24 Answers
Lars Filusch avatar image
Lars Filusch answered ·

installed @venusOS 2.8~33

But do not manage to install a package


4 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
I'd like to help with your issue but need some additional information.

Is PackageManager running? You should see it's menu at the bottom of Settings. It will indicate if PackageManager is running.

The latest version does not install any packages by default. You need to add them manually from the inactive packages list.

Logs may help. They are available via the command line at:

/data/log/SetupHelper

and /data/log/PackageManager/current

0 Likes 0 ·
Lars Filusch avatar image Lars Filusch Kevin Windrem commented ·

yes PackageManager is running, there are packages at the inactive page, nut i can´t install them, nothing happened...logs.zip

0 Likes 0 ·
logs.zip (2.3 KiB)
Kevin Windrem avatar image Kevin Windrem Lars Filusch commented ·

Thanks for the logs.

What version of SetupHelper are you running?


I checked the change log and v4.0~31 fixed an index out of range crash in that section of code. This happened when there are NO packages in the list, as when you run v4.0 for the first time.

The current beta version is v4.0~38

0 Likes 0 ·
Lars Filusch avatar image Lars Filusch Kevin Windrem commented ·

reinstall beta

seams to be running as it shout be...

thx

0 Likes 0 ·
Kevin Windrem avatar image
Kevin Windrem answered ·

Update: I'm nearing the beta test phase for SetupHelper 4.0.

The latest version (v4.0~30) includes a settings backup and restore mechanism similar to the one Victorn is working on. Victron is saving the settings XML file and restoring portions of it and has reported problems. My mechanism reads select parameters from com.victronergy.settings via dbus and writes them to a file, then reverses that for the restore. Settings must exist to be saved and also to be restored. When the Victron mechanism is released, this one will be removed.

I have been working with 123electric to incorporate the first third party package for SetupHelper: 123SmartBMS-Venus. Thanks to all who have taken time to test and provide feedback.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image
Kevin Windrem answered ·

v4.0 beta has ended. Released version available. See revised text in original post above.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

vassilis-bourdakis avatar image
vassilis-bourdakis answered ·

not sure what's going on, woke up today to both my systems showing a blank screen (accessed remotely) were fine last night. Tried checking what may be wrong, didn't go far.

The Rpi which is next to my desk (test rig) was easy to try the blind install, didn't work. rebooted, cleared everything related to SetupHelper from /data, tried blind install again, worked (as in I see that there is a /data/SetupHelper folder now there) screen is still blank.

Ideas welcomed. Obvs, system runs fine, coms with bms fine, reports ok.

Adding /data/log/PackageManager/current log. Cannot seem to be able to add /data/log/SetupHelper in here...

cheers

V.


current.txt


EDIT: re did the blind install having first wiped the SetupHelper log now log states:

@4000000061e2b5251ae984cc SetupHelper/reinstallMods: /data/reinstallScriptsList file not found
@4000000061e2b5260b6e3754 SetupHelper-blind/blindInstall: waiting for dBus settings
@4000000061e2b527312d8bd4 SetupHelper-blind/blindInstall: waiting for dBus settings
@4000000061e2b529185df404 SetupHelper-blind/blindInstall: waiting for dBus settings
@4000000061e2b52d07838fa4 SetupHelper-blind/blindInstall: blind install did NOT update SetupHelper (probably an older version)
~

and the current:

@4000000061e2b61416ee7db4 Traceback (most recent call last):
@4000000061e2b61416ee913c   File "/data/SetupHelper/PackageManager.py", line 3229, in <module>
@4000000061e2b61416ee9cf4     main()
@4000000061e2b61416eea4c4   File "/data/SetupHelper/PackageManager.py", line 3162, in main
@4000000061e2b61416eeb464     package.MoveFlagFiles ()
@4000000061e2b61416eebc34   File "/data/SetupHelper/PackageManager.py", line 1306, in MoveFlagFiles
@4000000061e2b61416eec7ec     os.mkdir (optionsPath)
@4000000061e2b61416eecfbc FileNotFoundError: [Errno 2] No such file or directory: '/data/setupOptions/SetupHelper'
@4000000061e2b6150d301364 WARNING:>>>> PackageManager v4.0 starting
@4000000061e2b61518c5a2fc Traceback (most recent call last):
@4000000061e2b61518c5b29c   File "/data/SetupHelper/PackageManager.py", line 3229, in <module>
@4000000061e2b61518c5c23c     main()
@4000000061e2b61518c5ca0c   File "/data/SetupHelper/PackageManager.py", line 3162, in main
@4000000061e2b61518c5d5c4     package.MoveFlagFiles ()
@4000000061e2b61518c5dd94   File "/data/SetupHelper/PackageManager.py", line 1306, in MoveFlagFiles
@4000000061e2b61518c5e94c     os.mkdir (optionsPath)
@4000000061e2b61518c5f504 FileNotFoundError: [Errno 2] No such file or directory: '/data/setupOptions/SetupHelper'
~



current.txt (14.5 KiB)
3 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

dirkmuc avatar image dirkmuc commented ·
Same for me, blank screen. I also connect remotely with the Chrome browser on Mac OS.
0 Likes 0 ·
vassilis-bourdakis avatar image vassilis-bourdakis dirkmuc commented ·
are you also running Large? just wondering if that's going to help Kevin.
0 Likes 0 ·
dirkmuc avatar image dirkmuc vassilis-bourdakis commented ·

Yes, I run v2.80~33-large-24 on a 2GB Pi4

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image
Stefanie (Victron Energy Staff) answered ·

The whole package turned out really great! Thank you for the fantastic work. I think Victron is always looking for skilful and innovative developers!


Maybe a minor issue on PackageManager: the reboot feature (i.e. when required after installing RPiDisplaySetup) seems to do nothing and I had to use reboot from console or from the General menu.

And another one: when on keyboard, adding a package in Add package menu seems to be impossible. Scrolling down makes it landing on the Cancel button and there is no way to get onto the Proceed button, unless you tap on it with mouse or display.

2 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·

On the reboot failure:

Depending on the state of the system when the setup script is run, a reboot may not be required.

Did the active packages list indicate a reboot was needed?

Interesting on the keyboard issue as I've tested this several times. The buttons don't always highlight in the expected order but you should eventually get to the one you want. I don't actually have any control over this as it's handled in the Venus gui code.

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·

Yes, a reboot showed up in the active package list. And when I clicked reboot, it looks like the restart actually happened. But nothing really happens.

On the keyboard issue: this also happens on the navigation in the package edition, especially Previous Next Install Download Uninstall buttons with unpredictable results.

Cursor down gets me to Previous button. From there I would expect cursor right to get to the next menu item (I now know its cursor down...), but cursor right changes the Package Name to SetupHelper and makes Previous button disappear (because SetupHelper does not have this button). Same for all other active packages.

System: Venus OS v2.80~36 Rpi 4 v1.2 4GB

gui_current_log.txt

0 Likes 0 ·
gui-current-log.txt (16.6 KiB)
Kevin Windrem avatar image
Kevin Windrem answered ·

For those experiencing a blank screen, apologies. I've been in beta with v4.0 for some time and thought I'd found all such problems.

The logs provided don't show the GUI issue so I'll need the gui log: /data/log/gui/current

There is an issue in Package Manager as shown in the logs above which I will fix. This bug will prevent PackageManager from running

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

vassilis-bourdakis avatar image
vassilis-bourdakis answered ·

/data/log/gui/current, rpi4 running latest large:


@4000000061e2f11b06320d4c QVNCServer No password configured, accepting connection
@4000000061e2f11d1190548c QVNCServer disconnected from "127.0.0.1"
@4000000061e2f11d21a73a0c QVNCServer new incoming connection from "127.0.0.1"
@4000000061e2f11d26c6db64 QVNCServer Client protocol version RFB 003.003
@4000000061e2f11d26c6eeec
@4000000061e2f11d26c8852c QVNCServer No password configured, accepting connection
@4000000061e2f11d34df1e3c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f11d34e07dcc connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f17734dfe95c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f17734e173e4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f1d1350fcb2c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f1d1350fe29c connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f22b3518fabc connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f22b351a9cb4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f2853518e734 connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f2853518fea4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f2df351dec5c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f2df351e03cc connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f339350ab27c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f339350c779c connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f393351df814 connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f393351f9df4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f3ed351bd14c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_c24a0d9b5798_cable"
@4000000061e2f3ed351d4c34 connman/cmservice.cpp Update Property "Domains" ""
~

doesn't look v.helpful though Kevin :-(


V.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

vassilis-bourdakis avatar image
vassilis-bourdakis answered ·

and logs from my rpi3B+ running latest Large VenusOS on the boat which I've not even rebooted since this happened today.


/data/logs/PackageManager/current:

@4000000061e2215a352cb584 ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e2215b36713ba4 ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e2215c37af459c ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e2215d38f3009c ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e2215e3a3c5534 ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e221600033b454 ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e22161013787f4 ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e2216202795aac ./run: line 3: /data/SetupHelper/PackageManager.py: No such file or directory
@4000000061e22164285a873c WARNING:>>>> PackageManager v4.0 starting
@4000000061e221651fd1d214 WARNING:adding GuiMods2
@4000000061e29436288413f4 *** CCGX booted (0) ***
@4000000061e2943a34212184 WARNING:>>>> PackageManager v4.0 starting

/data/logs/gui/current:

@4000000061e2f3022c4d6c4c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f3022c4fc1f4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f35c2c496cdc connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f35c2c4baefc connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f3b62c51ae24 connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f3b62c51d14c connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f4102c50fe5c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f4102c512184 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f46a2c10a99c connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f46a2c10ccc4 connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f4c42c0b17d4 connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f4c42c0dabfc connman/cmservice.cpp Update Property "Domains" ""
@4000000061e2f51e2c4bf164 connman/cmservice.cpp Property changed "/net/connman/service/ethernet_ba076e5362ef_cable"
@4000000061e2f51e2c4e470c connman/cmservice.cpp Update Property "Domains" ""

/data/logs/SetupHelper:

@4000000061d85682082f2d3c SetupHelper/setup: installing default packge list
@4000000061d856821061affc SetupHelper/setup: restarting SetupHelper service
@4000000061d8568215951004 SetupHelper/setup: completed
@4000000061d85683157199e4 SetupHelper/updatePackageVersions: creating dbus Setting /Settings/PackageVersion/2/PackageName
@4000000061d85685027591ec SetupHelper/updatePackageVersions: creating dbus Setting /Settings/PackageVersion/2/PackageVersion
@4000000061d856862e0dbdd4 SetupHelper/updatePackageVersions: creating dbus Setting /Settings/PackageVersion/3/PackageName
@4000000061d8568821b3867c SetupHelper/updatePackageVersions: removing dbus Settings /Settings/PackageVersion/4/PackageName /Settings/Pac
@4000000061d8573b2c717eac SetupHelper/setup: restarting SetupHelper service
@4000000061d8573b31ce82dc SetupHelper/setup: completed
@4000000061d857d43508417c GuiMods/setup: installing GuiMods files
@4000000061d857d52b7cc254 GuiMods/setup: ++ GuiMods installed
@4000000061d857d52f18926c GuiMods/setup: completed
@4000000061d857e63ae8dd2c SetupHelper/reinstallMods: waiting for dBus settings
@4000000061d857e936be7914 SetupHelper/reinstallMods: waiting for dBus settings
@4000000061d857eb25c6b144 SetupHelper/packageAutoUpdater: waiting for dBus settings
@4000000061d857ed1d716c14 SetupHelper/packageAutoUpdater: starting up
@4000000061de37e9333828e4 SetupHelper/packageAutoUpdater: ERROR: no version for SetupHelper kwindrem current on GitHub - can't continue
@4000000061de3a4135cc740c SetupHelper/packageAutoUpdater: ERROR: no version for GuiMods kwindrem current on GitHub - can't continue
@4000000061d857e637d305f4 SetupHelper/reinstallMods: waiting for dBus settings
@4000000061d857e9371b911c SetupHelper/reinstallMods: waiting for dBus settings
@4000000061d857eb2ce80e3c SetupHelper/packageAutoUpdater: waiting for dBus settings
@4000000061d857ec2b7de74c SetupHelper/reinstallMods: waiting for dBus settings
@4000000061d857ed31574b54 SetupHelper/packageAutoUpdater: starting up
@4000000061e221600637b684 SetupHelper/packageAutoUpdater: found SetupHelper on GitHub
@4000000061e2216006d12bac SetupHelper/packageAutoUpdater: continuing in cleanup script - SetupHelper exiting
@4000000061e221620ead1a5c SetupHelper/packageAutoUpdaterCleanup: running SetupHelper setup script to reinstall
@4000000061e2216211b9ae7c SetupHelper/packageAutoUpdaterCleanup: reinstalling SetupHelper
@4000000061e22162387550d4 SetupHelper/setup: restarting PackageManager service
@4000000061e294342d921d64 SetupHelper/reinstallMods: reinstallMods starting
@4000000061e294360652a8f4 SetupHelper/reinstallMods: waiting for dBus settings
@4000000061e2943904c93e1c SetupHelper/reinstallMods: waiting for dBus settings
@4000000061e2943e32b5c9e4 SetupHelper/reinstallMods: reinstallMods complete

not sure how old these are though.

hope it helps

V.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image
Kevin Windrem answered ·

Sorry for all the issues with v4.0.

I just put v4.1 up on GitHub

The white screen was related to the large version. This has been fixed.

I found a PackageManager crash on new systems that I believe I fixed this also.

Any more issues, please report immediately and include logs if possible:

tail -50 /data/log/PackageManager/current | tai64nlocal

tail -50 /data/log/SetupHelper | tai64nlocal

tail -50 /data/log/gui/current | tai64nlocal

1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

vassilis-bourdakis avatar image vassilis-bourdakis commented ·
usb blind install worked fine on the local rpi4, well done!

Now all the old mess is gone, packagemanager works fine, all's perfect!

Since I'm not planning to visit the boat now, any way to get the update on the other rpi from sh remotely?

What if I copy the contents of the tgz into /data and reboot once? :-)

it's only the SetupHelper-blind folder and the ._rcS.local and rcS.local files

cheers

V.


0 Likes 0 ·
Kevin Windrem avatar image
Kevin Windrem answered ·

You could do it that way. The two files from the archive you need are rcS.local and SetupHelper directory.

You could also copy the contents of SetupHelper from one system to another then run /data/SetupHelper/setup install


1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

vassilis-bourdakis avatar image vassilis-bourdakis commented ·
copied over the SetupHelper-blind and the rcS.local rebooted once, job done.

well done Kevin, many thanks for the work you've put on it!

cheers

V.

0 Likes 0 ·
Al avatar image
Al answered ·

Great work @Kevin Windrem! Thanks for spending the time on this to add to Venus OS.

Just updated the Venus beta, saw GuiMods had disappeared, but with the new package manager It was really simple to download and update SetupHelper and GuiMods and all working without having to faff around with Command line and micro sd cards. :)


screenshot-20220116-191657.png


2 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
Just so you know, package reinstalls are attempted when Venus OS firmware is updated. If a package detects an incompatible version it will not install, which is most likely why GuiMods disappeared.

The GUI-based PackageManager was intended to make upgrades painless.

If you leave auto downloads set to Normal and auto installs on then you'll get new versions as they are pushed to GitHub.

On mission critical systems, I recommend allowing new versions to download but not auto install so you can pick the time of update.

It's also easy to roll back by setting the branch/tag to a previous version number, downloading and installing. Even with auto downloads/installs enabled, you'll not move from that version until you change the branch.

Glad you found it useful.
0 Likes 0 ·
Al avatar image Al Kevin Windrem commented ·
Ah, that makes sense about the 'incomplete' OS message or something like that I saw initially stopping GuiMod re-install.


Thanks for the tips, I'm only allowing update installs when I'm free to make sure everything works for Venus and GuiMods etc as a caution anyway.

Cheers Al

0 Likes 0 ·
johnny-brusevold avatar image
johnny-brusevold answered ·

@Kevin Windrem


Installed Setup Helper in blind mode, which worked fine, but detected something strange.


All input devices in node-red switched state to disconnected.

In the drop-down menu where I can, for example, select BMV-702, two units with the same name appeared. When I switched to unit two, everything worked as it should.

1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
I don't believe your node-red issues are related to SetupHelper. If you uninstall SetupHelper do the problems persist? If so, the problem lies elsewhere.
0 Likes 0 ·
abucas01 avatar image
abucas01 answered ·

@Kevin Windrem

After returning from holidays, my Cerbo updated to the new Setuphelper/package manager.
I had to enable Normal Auto downloads and Auto install.

After the system updated I had the following in the Active packages screen.

screenshot-2022-01-16-233913.png

So I did a Backup of the settings, then I uninstalled the GuiMod2 version (which I had previously removed when you combined the functionality into GuiMods), then removed the package.

After this GuiMods did not appear to be running, so I did a restore thinking this may fix it, but it did not. I then had to reboot the Cerbo to get GuiMods screens working again.

After this I am left with the following entries in ActivePackages


screenshot-2022-01-19-082102.png

Going into the <Blank> package entry and selecting remove package does nothing.

Is there a problem having this blank entry, if so how to remove it?

All else appears to be working ok




2 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·

The blank row is not good but if things are running I'd say it won't cause problems.

What happens when you try to remove it? Do you get any prompts? Does it just sit there removing ... ?

Can you send me the PackageManager log. zip the entire /data/log/PackageManager folder and post it as an issue to GitHub.

PackageManager looks in /data for things it thinks is a package. Those appear in the active packages list.

I created a new package and removed its name via dbus-spy. Even with a blank name, I was able to remove it from the active list.

I added GuiMods2 to /data manually and it appeared in the package list. I removed the directory, then removed the package from the active list. All worked OK.

There is a script in the SetupHelper directory that will wipe out all dbus settings related to PackageManger. This will cause PackageManager to rebuild it's settings from scratch. It is necessary for PackageManager to not be running at the time, hence the svc lines.

svc -d /service/PackageManager
/data/SetupHelper/removeManagerSettings
svc -u /service/PackageManager

After you run this script, I think it will rebuild the list from packages already in /data. But you may have to add packages back into the active list. You'll also need to set auto download and auto install again.

FYI, Backup and Restore only backup and restore settings for things you can transport from one system to another, or restore on the same system after some unexpected event. I purposely skip the PackageManger package database from this because those settings can't reliably be restored at a later time.

0 Likes 0 ·
abucas01 avatar image abucas01 Kevin Windrem commented ·

@Kevin Windrem,

I have added the zip file as an issue as requested.

I also ran the script you posted, and this has removed the Blank Active Package entry

0 Likes 0 ·
boatguy avatar image
boatguy answered ·

That feeling when your in way over your head but learning. I built a pi. I loaded venusOS. I made cables and can use the Victron Connect to see my devices from the remote console. I built a 5 lcd case. Now I need package manager. Blind install is perfect for noob like me. I format my USB in WIndows. I copy venus-data.tgz to it. I put it in the pi. The pi boots from my venus SD card. I go to the remote console, settings and scroll down. No Package manager. reboot twice as per instuctions. no Package manager. Im sure I am missing something, but I dont know what. SHould I unzip the tgz file? I realize I am new but Im figuring it out. Thanks


8 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
No, you should not unpack the .tgz file.

Do you have console access to Venus?

If so, look in /data. There should be a folder named SetupHelper. If you find SetupHelper-blind instead, the blind install didn't work for some reason. Logs are helpful if you can capture them:

/data/log/SetupHelper

/data/log/PackageManager/current

You can zip them and post them as an issue to SetupHelper on GitHub.

0 Likes 0 ·
boatguy avatar image boatguy Kevin Windrem commented ·

Turns out it was a bad usb/sd card or reader. I installed Package Manager. I used package manager to activate RPI DIsplay. But unfortunately even though my screen turns on the scan rate and or resolution must be bad because it literally scans and nothing is useable. I dont know how to calibrate, or adjust the display. I know the display is good because it works when I boot from my traditional PI OS sd card. It did have an install/driver step so maybe it wont work with Venus.


0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem boatguy commented ·
On my PI 4 the "official 7" Raspberry PI touchscreen" just worked without any tweaks. The only thing RpiDisplaySetup does is activate screen dimming and blanking.
0 Likes 0 ·
boatguy avatar image boatguy Kevin Windrem commented ·

This is what I bought. You will see in the description that it takes a driver to run. Oh well I learned a lot in this process and believe me I have wasted more money than a cheap screen. I never thought that it would be a raspian only device. Thanks for you help and patience. I love learning new things

Amazon.com: Longruner Raspberry Pi Touch Screen with Case, 5 Inch TFT LCD Display HDMI Module 800x480 for Raspberry Pi 3 2 Model B and RPI 1 B+ A BB Black PC Various Systems (with Protective Case) : Electronics


0 Likes 0 ·
Al avatar image Al boatguy commented ·
Is your main purpose for the screen to use it to view the Victron flow overview etc, or for other stuff with the pi?


Maybe not a solution for the latter, but could you run a tablet in kiosk mode. That's what I do with a ccgx and now an Amazon fire 10", which is also a better size than a 7" and has auto dimming.

0 Likes 0 ·
Al avatar image Al Al commented ·

@Boatguy If you have a spare tablet you can use local wifi with the Pi:

https://community.victronenergy.com/articles/5930/disable-hotkeys-in-venus-remote-console-on-lan.html

Which allows you to view with remote access on your tablet, Kiosk mode (Hotkeys disabled) as I have a touchscreen tablet and GuiMods also installed:

screenshot-20220120-183506.png

0 Likes 0 ·
boatguy avatar image boatguy Al commented ·
Great Idea! Thanks. I think thats what I will do. I will also start to figure out how to get my Onan generator on the screen like yours. Thanks for being patient. Im having so much fun learning.


0 Likes 0 ·
Al avatar image Al boatguy commented ·
My red box is blank using the more recent versions of GuiMods - Unless the generator is running - then it looks as above. It should be the same for you automatically once you if you have GuiMods installed.
0 Likes 0 ·
Lars Filusch avatar image
Lars Filusch answered ·

6038dfd5-351e-4a88-bf22-dc0507b8c5ec.jpegtrying to install RpiDisplaySetup

error file set incomplete,

also tried to remove and install again….


5 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
This usually means that one of the files the package replaces has been modified from what is supplied with the Venus update.

The simplest remedy is to reinstall the Venus firmware. And the easiest way to do that is to boot to the stored backup the INSTALL the version you want again. (Don't simply boot back to the original Venus version because it will have the modified file.)

0 Likes 0 ·
Lars Filusch avatar image Lars Filusch Kevin Windrem commented ·
Ok, íll give it a try

thx


0 Likes 0 ·
Lars Filusch avatar image Lars Filusch Lars Filusch commented ·

success !

only the slider for display brightness is missing....

bildschirmfoto-2022-01-22-um-190057.pngbildschirmfoto-2022-01-22-um-190138.png

original Rpi 7" touch display

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Lars Filusch commented ·

RpiDisplaySetup requires the setup script to be run again following the install. It should have rebooted and run the script again automatically but this might not have happened. Try running setup again from the PackageMonitor and see if it gets you the brightness slider.

If it works and you have console access to the GX device, send me the SetupHelper log:

tail -100 /data/log/SetupHelper | tai64nlocal.

To avoid clutter here, post as an issue to SetupHelepr on GitHub.

The reason for the second setup run is because the first one installs the display brightness overlay. The second one looks for the appropriate files in /sys and installs the brightness stuff if it is found.


0 Likes 0 ·
Lars Filusch avatar image Lars Filusch Kevin Windrem commented ·
success !

thx one more time

0 Likes 0 ·
Lars Filusch avatar image
Lars Filusch answered ·

is there an other method to rotate the display then to edit the /u-boot/config.txt ?

lcd_rotate=2

1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
Not that I know of
0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image
Stefanie (Victron Energy Staff) answered ·

Hi Kevin, my relay hat needs an alternative gpio_list, which unfortunately gets overwritten by SetupHelper after every Venus OS firmware update. I realize that a copy can be saved to the data partition and then the original replaced via a shell script or just manually by copying to /etc/venus.

I'm just wondering if there might be a much more convenient way, maybe via SetupHelper, and if I think about it further, maybe also the possibility to change the gpio_list via SetupHelper or an Gui_Mods element?

12 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·

v3.6 of RpiGpioSetup just put up on GitHub looks for /data/setupOptions/RpiGpioSetup/gpio_list and use that when installing that package instead of using gpio_list from the package directory.

You can place your custom GPIO list there. This storage is persistent and survives a Venus firmware update as well as a package update.

I hope that works for you. I'd rather not add setup script options or options to GuiMods to implement functionality that's probably best handled with a text editor anyway.

In the next update to SetupHelper, I will include the setupOptions directory in the PackageManager backup/restore settings functionality so you can transport this customization to another system.

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·

That's great! Much easier than I had imagined. I'll try that in a moment and just switch back and forth between different firmware versions.


I have a similar problem with the blanking of the 5" Waveshare DSI display. In order for blanking to work, I have to add the overlay manually after each firmware update with:


cd /u-boot/overlays
wget https://github.com/kwindrem/RpiDisplaySetup/raw/main/rpi-backlight-overlay.dtb
echo "/sys/class/graphics/fb0/blank" > /etc/venus/blank_display_device


Is there a more elegant solution for this, e.g. via RpiDisplaySetup?

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Stefanie (Victron Energy Staff) ♦♦ commented ·

As of v2.4, the RpiDisplaySetup setup script always installs the overlay, then reboots and runs setup again. So you should not need the wget.

The script then uses the presence of

/sys/class/backlight/rpi_backlight

to automatically select the RPI display or HDMI 0

For HDMI 0, it sets up the venus/blank_display_device exactly as you do manually.

So I'm not sure why RpiDisplaySetup isn't working without your additional steps.

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·

This is how I had to do it since using RpiDisplaySetup.

v2.4 made no difference, not even last night when I updated Venus to v2.80~43.

It's "only" the blanking that doesn't work. Everything else like the slider will install properly and is ok. I remember we had a lengthy thread in the past about dimming and blanking the Waveshare DSI display. Maybe I'm missing something here. Even considering to buy a bigger display..

By the way, at some point I was actually able to switch off the display so that the display was completely black and didn't even show the two white backlight LEDs on the bottom. I just can't remember how I managed it ;-)

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Stefanie (Victron Energy Staff) ♦♦ commented ·
I think the issue is the setup script is finding enough to think the display is the "official RPI touchscreen" so it is setting /etc/venus/blank... to point to the rpi device, not fb0.

You can't run the setup script manually because there is no option to have dimming enabled for HDMI 0.

I'll give the issue some thought.

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·

I can confirm that v3.6 of RpiGpioSetup is working now as expected and re-installs my custom gpio_list after firmware update to Venus OS 2.80~44.

For RpiDisplaySetup there is no change. Still requires manually update the overlay.

From /var/log/messages:

Jan 29 05:13:53 raspberrypi4 user.info kernel: [    0.268875] bcm2708_fb soc:fb: FB found 1 display(s)
Jan 29 05:13:53 raspberrypi4 user.info kernel: [    0.273510] Console: switching to colour frame buffer device 100x30
Jan 29 05:13:53 raspberrypi4 user.info kernel: [    0.275887] bcm2708_fb soc:fb: Registered framebuffer for display 0, size 800x480
Jan 29 05:13:53 raspberrypi4 user.info k
0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Stefanie (Victron Energy Staff) ♦♦ commented ·
RpiDisplaySetup v2.5 now permits custom blank and dimming files as I recently added for RpiGpioSetup.
0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·
Thanks very much, Kevin! I will report back after the next firmware update.
0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Kevin Windrem commented ·
i just posted v2.6 which allows a CUSTOM display type selection along with the /sys/class/... devices for blanking and dimming.

This works from the command line only but once the custom blank and dim files exist in /data/setupOptions/RpiDisplaySetup then an install will use that info ignoring the device type.

0 Likes 0 ·
Stefanie (Victron Energy Staff) avatar image Stefanie (Victron Energy Staff) ♦♦ Kevin Windrem commented ·
I can't see the custom option when calling setup from console.

Uninstalled and installed again from PackageManager plus deleting all RpiDisplaySetup files/folders manually did not help.

0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem Stefanie (Victron Energy Staff) ♦♦ commented ·
make sure you have RpiDisplaySetup v2.6


I just did the download and got the CUSTOM option during installation from the command line.

0 Likes 0 ·
Show more comments
satmaster200 avatar image
satmaster200 answered ·

Hi Kevin!

I like SetupHelper and the PackageManager a lot and want to thank you first of all for the great work you provide to the communitiy!

I have these packages installed:

bildschirmfoto-2023-01-21-um-112731.png

I think, since I upgraded to Venus OS 3.00-15 the PackageManager shows mangled menus:


bildschirmfoto-2023-01-21-um-111659.pngbildschirmfoto-2023-01-21-um-111845.png

When I further scroll down, it get's all "overlayed" on top of each other somehow and is not acessible properly anymore:

bildschirmfoto-2023-01-21-um-112102.pngI allready reinitialised the PackageManager but that did not solve the Problem

bildschirmfoto-2023-01-21-um-112303.png

Is this a kown Issue? Am I doing something wrong here? What can be done to resolve the issue?

Oh and I hope this is the right spot "report issues"?


Thank you very much!


5 comments
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
Yes, a known issue. Testing a fix now.
1 Like 1 ·
satmaster200 avatar image satmaster200 Kevin Windrem commented ·

Thanks Kevin!

Much appreciated!


0 Likes 0 ·
pau1phi11ips avatar image pau1phi11ips commented ·

@satmaster200 It's best to stick to the non-beta Venus releases if you're using mods

0 Likes 0 ·
satmaster200 avatar image satmaster200 pau1phi11ips commented ·
Yes true! But this is my test system, so I'm fine finding and reporting some issues as they can be fixed for the next major release.
0 Likes 0 ·
Kevin Windrem avatar image Kevin Windrem satmaster200 commented ·
I do appreciate the help testing my software. Thanks.
0 Likes 0 ·
hussl1 avatar image
hussl1 answered ·

did a blind install as mentioned in the readme. Seemed to have worked, but somehow setuphelper appears to behave strangely. Already tried to initialize and rebooted the cerbo several times. Setup helper appears to do nothing. Happy easter everyone!

img-3944.png

img-3945.png

img-3946.png

img-3947.png


img-3947.png (310.1 KiB)
img-3946.png (310.8 KiB)
img-3945.png (240.0 KiB)
img-3944.png (325.7 KiB)
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image
Kevin Windrem answered ·

I'd need logs to look into this. There are instructions in SetupHelper ReadMe to gather logs even if you don't have command line access.

Please post the logs to the issues section of the SetupHelper GitHub repo.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

thomas-pv avatar image
thomas-pv answered ·

Hello,

does the package manager work on Cerbo GX with small (not large) venus os?


1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image Kevin Windrem commented ·
Yes.
1 Like 1 ·
harlov avatar image
harlov answered ·

Hey @Kevin Windrem I just updated my Cerbo to the latest v3.32, after having Guimods installed for about 6 months now. All working fine.

However after i updated, it gave me the white screen I've seen on other posts. Fortunately i could fix it with a hard reboot of the Cerbo.

Although, I am having an issue updating SetupHelper.

I have SetupHelper v5.15 installed, but v8.5 Stored after it downloaded, although it wont allow me updated. It says "incompatible ???" and when i try to install it says give as error.

Guimods did however update to the latest v10.36. Is it critical to get the SetupHelper updated as well and if so any solutions?

Then second question, if i want to install OS Large for Node RED, is there anything specific that needs to be done or will it work with my current install?

Thanks

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

Kevin Windrem avatar image
Kevin Windrem answered ·

I highly recommend updating SetupHelper.

As always, reboot first. This may clear the fault.


There have been significant changes in the way incompatibility is reported to the GUI between 5.15 and 8.x and if the GUI code is not in sync with PackageManager and CommonResources this particular message could be displayed. In v8.x there are incompatibility reasons that may not actually prevent install. That is, PackageManager might be able to resolve them. But the old version of the GUI might prevent the install.

Logs may be of some help figuring out the incompatible ??? message. The SetupHelper ReadMe has instructions on how to extract the logs files if you don't have ssh access.

If you do have ssh access, try uninstalling then reinstalling SetupHelper:

/data/SetupHelper/setup uninstall auto

/data/SetupHelper/setup install auto


If not, you can force everything to reinstall by reinstalling Venus OS:

switch to the backup firmware then use online updates to update again to the current version. (simpy switching back to the original firmware version in the stored firmware menu won't force a reinstall)


The normal and large versions work fine with all my packages including SetupHelper although there are some authored by others that may require the large version. So check those packages with the author.

2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

harlov avatar image
harlov answered ·

Thanks for the quick reply @Kevin Windrem

I uninstalled SetupHelper through the cerbo interface and reinstalled via USB method, so that up to date now at v8.85.

However after installing Large, it promoted me to update firmware to V3.33. This removed my GUImods. When i went into packet manger to reinstall it (v10.36) it says "GuiMods install failed - incomplete file set for v3.33"

1 comment
2 |3000

Up to 8 attachments (including images) can be used with a maximum of 190.8 MiB each and 286.6 MiB total.

harlov avatar image harlov commented ·
v10.38 fixed the issue. thanks!
0 Likes 0 ·

Related Resources

Victron Venus OS Open Source intro page

Venus OS GitHub (please do not post to this)

Additional resources still need to be added for this topic