The arozos repo

tobychui 3e5305a0f7 Aded WebDAV connection instruction %!s(int64=2) %!d(string=hai) anos
documents 23d71a9785 Added WIP new file server page in sys setting (DO NOT DEPLOY) %!s(int64=2) %!d(string=hai) anos
examples 0f84a11f18 Added darknet_arm64 and smart_arm64 binary %!s(int64=3) %!d(string=hai) anos
legacy 4cc3c16343 Added working multi-client ssh sftp server implementation in start %!s(int64=2) %!d(string=hai) anos
mod 56573f7022 Fixed image loading in wifi page %!s(int64=2) %!d(string=hai) anos
subservice 8c06b2ebb1 Updated gzip handler to prevent subservice load fail on Firefox %!s(int64=3) %!d(string=hai) anos
system 5b70ed8bd4 Added toggle-able SFTP server %!s(int64=2) %!d(string=hai) anos
web 3e5305a0f7 Aded WebDAV connection instruction %!s(int64=2) %!d(string=hai) anos
.gitignore db3eec2ec5 reverted main.go %!s(int64=3) %!d(string=hai) anos
AGI Documentation.md e9e5d33bc5 Added partial relative path support in agi %!s(int64=2) %!d(string=hai) anos
Makefile 3dd7c868ac Added WIP system wide log %!s(int64=3) %!d(string=hai) anos
README.md fea73b48aa Updated README %!s(int64=2) %!d(string=hai) anos
agi.go 26245723f0 Name changed from Lambda to ARZ Serverless %!s(int64=2) %!d(string=hai) anos
apt.go 3dd7c868ac Added WIP system wide log %!s(int64=3) %!d(string=hai) anos
auth.go 3dd7c868ac Added WIP system wide log %!s(int64=3) %!d(string=hai) anos
autopush.bat 8052702e98 Updated permission modes %!s(int64=4) %!d(string=hai) anos
autopush.sh 8052702e98 Updated permission modes %!s(int64=4) %!d(string=hai) anos
build.sh 7ef75ffbd1 Fixed more bugs %!s(int64=3) %!d(string=hai) anos
buildFullErrorList.bat 8052702e98 Updated permission modes %!s(int64=4) %!d(string=hai) anos
build_binary-only.sh 8052702e98 Updated permission modes %!s(int64=4) %!d(string=hai) anos
cluster.go 32bf29e0ab Updated shutdown sequence log %!s(int64=3) %!d(string=hai) anos
console.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
desktop.go 5b70ed8bd4 Added toggle-able SFTP server %!s(int64=2) %!d(string=hai) anos
devices.go cdc2320d26 Moved locate.html to info tab %!s(int64=4) %!d(string=hai) anos
disk.go 32bf29e0ab Updated shutdown sequence log %!s(int64=3) %!d(string=hai) anos
error.go 5b70ed8bd4 Added toggle-able SFTP server %!s(int64=2) %!d(string=hai) anos
file_system.go 02e6eb6b0a Completed experimental SFTP client %!s(int64=2) %!d(string=hai) anos
go.mod 35595ba702 Added WIP sftp driver %!s(int64=2) %!d(string=hai) anos
go.sum 35595ba702 Added WIP sftp driver %!s(int64=2) %!d(string=hai) anos
hardware.power.go 32bf29e0ab Updated shutdown sequence log %!s(int64=3) %!d(string=hai) anos
iot.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
ldap.go 41ab40a03d Updated LDAP to make it better %!s(int64=3) %!d(string=hai) anos
localhost.crt 40ea2c13f5 Updated certificate %!s(int64=4) %!d(string=hai) anos
localhost.key 40ea2c13f5 Updated certificate %!s(int64=4) %!d(string=hai) anos
main.flags.go 8ea67d874b Updated version number to 2.006 %!s(int64=2) %!d(string=hai) anos
main.go cf62cab843 Fixed force shutdown not working when startup bug %!s(int64=2) %!d(string=hai) anos
main.router.go c9857734a8 Added working buffer fs driver for WebDAV server %!s(int64=2) %!d(string=hai) anos
mediaServer.go aab53b790e Fixed issue 105 for ai files turning into pdf %!s(int64=3) %!d(string=hai) anos
module.go 32bf29e0ab Updated shutdown sequence log %!s(int64=3) %!d(string=hai) anos
module.util.go 0aaf1582e5 Updated many smaller pages from tocasv2 to segmentic %!s(int64=3) %!d(string=hai) anos
network.forward.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos
network.go 33d33fa0ee Completed SFTP setting page %!s(int64=2) %!d(string=hai) anos
notification.go ee4cdd3116 Update notification.go %!s(int64=3) %!d(string=hai) anos
oauth.go 52791b19f8 Fixed diskmg unable to render not partitioned disk bug %!s(int64=4) %!d(string=hai) anos
openwrt-build.bat 0f84a11f18 Added darknet_arm64 and smart_arm64 binary %!s(int64=3) %!d(string=hai) anos
permission.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos
quota.go ed22d4195e Merge branch 'systemLog-20220823' of tmp/arozos into master %!s(int64=3) %!d(string=hai) anos
register.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
riscv64-build.bat e523a3e131 Added experimental riscv64 support %!s(int64=3) %!d(string=hai) anos
scheduler.go d18e547df2 Added web root agi excution feature and removed scheudler %!s(int64=2) %!d(string=hai) anos
security.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
setting.advance.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
setting.go 23d71a9785 Added WIP new file server page in sys setting (DO NOT DEPLOY) %!s(int64=2) %!d(string=hai) anos
start.sh ecdded5c02 Added localization for authreq %!s(int64=4) %!d(string=hai) anos
startup.flags.go 050a88d3fd Optimized File Manager auto refresh during listDir %!s(int64=3) %!d(string=hai) anos
startup.go 5b70ed8bd4 Added toggle-able SFTP server %!s(int64=2) %!d(string=hai) anos
storage.bridge.go e9e6976874 Optimized log output for highest abstraction layer %!s(int64=3) %!d(string=hai) anos
storage.go 56ced27e29 Added hearbeat ticker stop to close setup %!s(int64=2) %!d(string=hai) anos
storage.pool.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos
subservice.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
system.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos
system.info.go 4e887ed8e0 Fixed uptime viewing permission %!s(int64=2) %!d(string=hai) anos
system.resetpw.go f3ed495937 Migrated all root source code to use common module %!s(int64=3) %!d(string=hai) anos
test.go 0f84a11f18 Added darknet_arm64 and smart_arm64 binary %!s(int64=3) %!d(string=hai) anos
update-licenses.bat 328858bf9a Added template for nfs abstraction %!s(int64=3) %!d(string=hai) anos
user.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos
wifi.go 1485c2824c replaced log.Println to systemWideLogger.PrintAndLog %!s(int64=3) %!d(string=hai) anos

README.md

ArozOS 2.0

This is the go implementation of ArozOS (aka ArOZ Online) Web Desktop environment,designed to run on linux, but somehow still works on Windows and Mac OS

This README file is intended for developer only. If you are normal users, please refer to the README file outside of the /src folder.

Development Notes

  • Start each module with {ModuleName}Init() function, e.g. WiFiInit()
  • Put your function in mod (if possible) and call it in the main program
  • Do not change the sequence in the startup() function unless necessary
  • When in doubt, add startup flags (and use startup flag to disable experimental functions on startup)

File System Virtualization and File System Abstractions Layers

The ArozOS system contains both the virtualization layer and abstraction layer. The easiest way to check if your path is under which layer is by looking at their starting dir name.

Path Structure Example Path Layer
{vroot_id}:/{subpath} user:/Desktop/myfile.txt File System Virtualization Layer (Highest Layer)
fsh (*File System Handler) + subpath (string) fsh (localfs) + /files/users/alan/Desktop/myfile.txt File System Abstraction
{physical_location}/{subpath} /home/aroz/arozos/files/users/Desktop/myfile.txt Physical (Disk) Layer

Since ArozOS v2.000, we added File System Abstraction (fsa, or sometime as seen as fshAbs, abbr for "File System Handler underlaying File System Abstraction) to the (already complex) File System Handler (fsh) infrastruture. There are two type of fsh that are currently supported by ArozOS File System Abstraction layer.

ArOZ JavaScript Gateway Interface / Plugin Loader

The ArOZ AJGI / AGI interface provide a JavaScript programmable interface for ArozOS users to create plugin for the system. To initiate the module, you can place a "init.agi" file in the web directory of the module (also named the module root). See more details in the AJGI Documentation.

AGI script can be run as different scope and permissions.

Scope Usable Functions
WebApp startup script (init.agi) System Functions and Registrations
WebApp contained scripts System Functions and User Functions
Others (Web Root / Serverless / Scheduler) System Functions, User Functions ( with script register owner scope) and serverless

Subservice Logics and Configuration

To intergrate other binary based web server to the subservice interface, you can create a folder inside the "./subservice/your_service" where your binary executable should be named identically with the containing directory. For example, you have a module that provides web ui named "demo.exe", then your should put the demo.exe into "./subservice/demo/demo.exe".

In the case of Linux environment, the subservice routine will first if the module is installed via apt-get by checking with the "which" program. (If you got busybox, it should be built in) If the package is not found in the apt list, the binary of the program will be searched under the subservice directory.

Please follow the naming convention given in the build.sh template. For example, the corresponding platform will search for the corresponding binary excitable filename:

demo_linux_amd64    => Linux AMD64
demo_linux_arm      => Linux ARMv6l / v7l
demo_linux_arm64    => Linux ARM64
demo_macOS_amd64    => MacOS AMD64 

Startup Flags

During the startup of the subservice, two types of parameter will be passed in. Here are the examples

demo.exe -info
demo.exe -port 12810 -rpt "http://localhost:8080/api/ajgi/interface"

In the case of receiving the "info" flag, the program should print the JSON string with correct module information as stated in the struct below.

//Struct for storing module information
type serviecInfo struct{
    Name string                //Name of this module. e.g. "Audio"
    Desc string                //Description for this module
    Group string            //Group of the module, e.g. "system" / "media" etc
    IconPath string            //Module icon image path e.g. "Audio/img/function_icon.png"
    Version string            //Version of the module. Format: [0-9]*.[0-9][0-9].[0-9]
    StartDir string         //Default starting dir, e.g. "Audio/index.html"
    SupportFW bool             //Support floatWindow. If yes, floatWindow dir will be loaded
    LaunchFWDir string         //This link will be launched instead of 'StartDir' if fw mode
    SupportEmb bool            //Support embedded mode
    LaunchEmb string         //This link will be launched instead of StartDir / Fw if a file is opened with this module
    InitFWSize []int         //Floatwindow init size. [0] => Width, [1] => Height
    InitEmbSize []int        //Embedded mode init size. [0] => Width, [1] => Height
    SupportedExt []string     //Supported File Extensions. e.g. ".mp3", ".flac", ".wav"
}

//Example Usage when reciving the -info flag
infoObject := serviecInfo{
        Name: "Demo Subservice",
        Desc: "A simple subservice code for showing how subservice works in ArOZ Online",            
        Group: "Development",
        IconPath: "demo/icon.png",
        Version: "0.0.1",
        //You can define any path before the actualy html file. This directory (in this case demo/ ) will be the reverse proxy endpoint for this module
        StartDir: "demo/home.html",            
        SupportFW: true, 
        LaunchFWDir: "demo/home.html",
        SupportEmb: true,
        LaunchEmb: "demo/embedded.html",
        InitFWSize: []int{720, 480},
        InitEmbSize: []int{720, 480},
        SupportedExt: []string{".txt",".md"},
    }

jsonString, _ := json.Marshal(info);
fmt.Println(string(infoObject))
os.Exit(0);

When receiving the port flag, the program should start the web ui at the given port. The following is an example for the implementation of such functionality.

var port = flag.String("port", ":80", "The default listening endpoint for this subservice")
flag.Parse()
err := http.ListenAndServe(*port, nil)
if err != nil {
    log.Fatal(err)
}

Subservice Exec Settings

In default, subservice routine will create a reverse proxy with URL rewrite build in that serve your web ui launched from the binary executable. If you do not need a reverse proxy connection, want a custom launch script or else, you can use the following setting files.

.noproxy        => Do not start a proxy to the given port
.startscript    => Send the launch parameter to the "start.bat" or "start.sh" file instead of the binary executable
.disabled        => Do not load this subservice during startup. But the user can enable it via the setting interface

Here is an example "start.bat" used in integrating Syncthing into ArOZ Online System with ".startscript" file placed next to the syncthing.exe file.

if not exist ".\config" mkdir ".\config"
syncthing.exe -home=".\config" -no-browser -gui-address=127.0.0.1%2

Systemd support

To enable systemd in your host that support aroz online system, create a bash script at your aroz online root named "start.sh" and fill it up with your prefered startup paratmers. The most basic one is as follow:

#/bin/bash
sudo ./aroz_online_linux_amd64

And then you can create a new file called "arozos.service" in /etc/systemd/system with the following contents (Assume your aroz online root is at /home/pi/arozos)

[Unit]
Description=ArozOS Cloud Desktop Service.

[Service]
Type=simple
WorkingDirectory=/home/pi/arozos/
ExecStart=/bin/bash /home/pi/arozos/start.sh

Restart=always
RestartSec=10

[Install]
WantedBy=multi-user.target

Finally to enable the service, use the following systemd commands

#Enable the script during the startup process
sudo systemctl enable arozos.service

#Start the service now
sudo systemctl start arozos.service

#Show the status of the service
systemctl status arozos.service


#Disable the service if you no longer want it to start during boot
sudo systemctl disable aroz-online.service