Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
stylenone

Overview

The following page describes deploying Syndeia Cloud (SC) in an air-gapped environment. At a high level the procedure is as follows:

  1. From your local machine: Download the SC installation packages, extract them temporarily to gain access to the pre-setup scripts

  2. From your local machine: Run the infrastructure components (Cassandra, JanusGraph, Kafka, Zookeeper) pre-setup scripts to download their packages.

  3. From your local machine: Batch transfer all previously downloaded installation packages to the network/machine where SC will be deployed by going through whatever security enclave vetting procedure required.

  4. On the target machine: Continue with the deployment process on the target machine by running the installation scripts to deploy/upgrade Syndeia Cloud and its infrastructure components.

...

Prerequisites

  • A machine with Internet access

  • These steps should be run on a Linux flavor (Alma or RedHat (RHEL)) that is equivalent to the target Syndeia Cloud (SC) server’s, ie: if your target SC server is running Alma Linux then make sure your local machine is running Alma Linux. If your target SC server is running RedHat Enterprise Linux (RHEL) then make sure your local machine is running RedHat Enterprise Linux (RHEL).

...

Steps

1. Syndeia Cloud

  1. Download SC installation packages using the links provided with your license request (via Intercax Helpdesk) to your home folder (~) and extract the following three (3) zip files:

    1. syndeia-cloud-3.6-SP1_cassandra_zookeeper_kafka_setup.zip

    2. syndeia-cloud-3.6-SP1_janusgraph_setup.zip

    3. syndeia-cloud-3.6-SP1.zip

  2. Open a bash shell prompt.

  3. Temporarily unzip all .ZIPs to get access to the pre-setup scripts

2. Infrastructure

2.1. Cassandra

Step 2.1.1 - Download SC Cassandra related packages via the following two commands:

...

Expand
titleAlma Linux `syndeia-cloud-3.6_cassandra_pre-setup.bash -d` sample output. ℹ️ Note, most of these dependencies (see L200~284) are pulled in due to Cassandra v4.1.0’s dependency on the non-headless Java package.
Code Block
languagebash
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$ ./syndeia-cloud-3.6_cassandra_pre-setup.bash -d
+ shopt -s extglob
+ shopt -s globstar
++ readlink -f ./syndeia-cloud-3.6_cassandra_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin/syndeia-cloud-3.6_cassandra_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01
+ SC_version_parsed=3.6-SP1.2024-10-01
+ SC_version=3.6-SP1.2024-10-01
+ service_name=cassandra
+ Cassandra_build_ver=4.1.0
++ uname
+ OS=Linux
+ [[ Linux =~ CYGWIN ]]
+ systemctl=systemctl
+ sudo=sudo
+ cassandra_yaml=/etc/cassandra/default.conf/cassandra.yaml
+ cassandra_jar_path=/usr/share/cassandra
+ [[ -d /usr/share/cassandra ]]
+ cluster_name='SC Cluster'
+ num_tokens=256
+ listen_address=localhost
+ rpc_address=localhost
+ write_request_timeout_in_ms=20000
+ batch_size_fail_threshold_in_kb=300
+ umask 0002
+ pushd .
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin ~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin
+ cd /home/jdoe/
+ [[ -d == \-\d ]]
+ [[ Linux =~ CYGWIN ]]
+ [[ ! Linux =~ CYGWIN ]]
++ which wget
++ alias
++ eval declare -f
+++ declare -f
++ /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot wget
+ [[ ! -n /usr/bin/wget ]]
++ which python
++ alias
++ eval declare -f
+++ declare -f
++ /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot python
/usr/bin/which: no python in (/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin)
+ [[ ! -n '' ]]
+ sudo yum install --downloadonly -y python2
Last metadata expiration check: 0:28:55 ago on Wed 16 Oct 2024 07:40:24 PM UTC.
Dependencies resolved.
=============================================================================================================================================================================
 Package                                     Architecture              Version                                                            Repository                    Size
=============================================================================================================================================================================
Installing:
 python2                                     x86_64                    2.7.18-17.module_el8.10.0+3783+2756348e.alma                       appstream                    110 k
Installing dependencies:
 python2-libs                                x86_64                    2.7.18-17.module_el8.10.0+3783+2756348e.alma                       appstream                    6.0 M
 python2-pip-wheel                           noarch                    9.0.3-19.module_el8.6.0+2781+fed64c13                              appstream                    891 k
 python2-setuptools-wheel                    noarch                    39.0.1-14.module_el8.10.0+3783+2756348e                            appstream                    286 k
Installing weak dependencies:
 python2-pip                                 noarch                    9.0.3-19.module_el8.6.0+2781+fed64c13                              appstream                    1.6 M
 python2-setuptools                          noarch                    39.0.1-14.module_el8.10.0+3783+2756348e                            appstream                    641 k
Enabling module streams:
 python27                                                              2.7                                                                                                  

Transaction Summary
=============================================================================================================================================================================
Install  6 Packages

Total download size: 9.5 M
Installed size: 37 M
YUM will only download packages for the transaction.
Downloading Packages:
(1/6): python2-2.7.18-17.module_el8.10.0+3783+2756348e.alma.x86_64.rpm                                                                        73 kB/s | 110 kB     00:01    
(2/6): python2-pip-wheel-9.0.3-19.module_el8.6.0+2781+fed64c13.noarch.rpm                                                                    1.8 MB/s | 891 kB     00:00    
(3/6): python2-pip-9.0.3-19.module_el8.6.0+2781+fed64c13.noarch.rpm                                                                          747 kB/s | 1.6 MB     00:02    
(4/6): python2-setuptools-wheel-39.0.1-14.module_el8.10.0+3783+2756348e.noarch.rpm                                                           810 kB/s | 286 kB     00:00    
(5/6): python2-setuptools-39.0.1-14.module_el8.10.0+3783+2756348e.noarch.rpm                                                                 844 kB/s | 641 kB     00:00    
(6/6): python2-libs-2.7.18-17.module_el8.10.0+3783+2756348e.alma.x86_64.rpm                                                                  1.8 MB/s | 6.0 MB     00:03    
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                        2.8 MB/s | 9.5 MB     00:03     
Complete!
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'yum clean packages'.
+ sudo yum install --downloadonly --destdir /home/jdoe/ -y yum-plugin-versionlock
Last metadata expiration check: 0:29:00 ago on Wed 16 Oct 2024 07:40:24 PM UTC.
Dependencies resolved.
=============================================================================================================================================================================
 Package                                                  Architecture                     Version                                    Repository                        Size
=============================================================================================================================================================================
Installing:
 python3-dnf-plugin-versionlock                           noarch                           4.0.21-25.el8                              baseos                            64 k

Transaction Summary
=============================================================================================================================================================================
Install  1 Package

Total download size: 64 k
Installed size: 27 k
YUM will only download packages for the transaction.
Downloading Packages:
python3-dnf-plugin-versionlock-4.0.21-25.el8.noarch.rpm                                                                                      3.0 MB/s |  64 kB     00:00    
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                        633 kB/s |  64 kB     00:00     
Complete!
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'yum clean packages'.
+ sudo yum install --downloadonly --destdir /home/jdoe/ -y java-11-openjdk-headless-11.0.23.0.9-3.el8
Last metadata expiration check: 0:29:01 ago on Wed 16 Oct 2024 07:40:24 PM UTC.
Dependencies resolved.
=============================================================================================================================================================================
 Package                                       Architecture                Version                                                      Repository                      Size
=============================================================================================================================================================================
Installing:
 java-11-openjdk-headless                      x86_64                      1:11.0.23.0.9-3.el8                                          appstream                       42 M
Installing dependencies:
 alsa-lib                                      x86_64                      1.2.10-2.el8                                                 appstream                      500 k
 avahi-libs                                    x86_64                      0.7-27.el8_10.1                                              baseos                          61 k
 copy-jdk-configs                              noarch                      4.0-2.el8                                                    appstream                       29 k
 cups-libs                                     x86_64                      1:2.2.6-60.el8_10                                            baseos                         436 k
 javapackages-filesystem                       noarch                      5.3.0-2.module_el8.0.0+6004+2fc32706                         appstream                       30 k
 lksctp-tools                                  x86_64                      1.0.18-3.el8                                                 baseos                          99 k
 lua                                           x86_64                      5.3.4-12.el8                                                 appstream                      191 k
 nspr                                          x86_64                      4.35.0-1.el8_8                                               appstream                      142 k
 nss                                           x86_64                      3.101.0-7.el8_8                                              appstream                      764 k
 nss-softokn                                   x86_64                      3.101.0-7.el8_8                                              appstream                      530 k
 nss-softokn-freebl                            x86_64                      3.101.0-7.el8_8                                              appstream                      391 k
 nss-sysinit                                   x86_64                      3.101.0-7.el8_8                                              appstream                       75 k
 nss-util                                      x86_64                      3.101.0-7.el8_8                                              appstream                      141 k
 tzdata-java                                   noarch                      2024a-1.el8                                                  appstream                      186 k

Transaction Summary
=============================================================================================================================================================================
Install  15 Packages

Total download size: 45 M
Installed size: 187 M
YUM will only download packages for the transaction.
Downloading Packages:
(1/15): avahi-libs-0.7-27.el8_10.1.x86_64.rpm                                                                                                3.0 MB/s |  61 kB     00:00    
(2/15): cups-libs-2.2.6-60.el8_10.x86_64.rpm                                                                                                  11 MB/s | 436 kB     00:00    
(3/15): copy-jdk-configs-4.0-2.el8.noarch.rpm                                                                                                757 kB/s |  29 kB     00:00    
(4/15): lksctp-tools-1.0.18-3.el8.x86_64.rpm                                                                                                 1.1 MB/s |  99 kB     00:00    
(5/15): javapackages-filesystem-5.3.0-2.module_el8.0.0+6004+2fc32706.noarch.rpm                                                              1.2 MB/s |  30 kB     00:00    
(6/15): lua-5.3.4-12.el8.x86_64.rpm                                                                                                          8.1 MB/s | 191 kB     00:00    
(7/15): alsa-lib-1.2.10-2.el8.x86_64.rpm                                                                                                     3.9 MB/s | 500 kB     00:00    
(8/15): nspr-4.35.0-1.el8_8.x86_64.rpm                                                                                                       985 kB/s | 142 kB     00:00    
(9/15): nss-softokn-3.101.0-7.el8_8.x86_64.rpm                                                                                               6.5 MB/s | 530 kB     00:00    
(10/15): nss-softokn-freebl-3.101.0-7.el8_8.x86_64.rpm                                                                                       9.1 MB/s | 391 kB     00:00    
(11/15): nss-sysinit-3.101.0-7.el8_8.x86_64.rpm                                                                                              5.6 MB/s |  75 kB     00:00    
(12/15): nss-3.101.0-7.el8_8.x86_64.rpm                                                                                                      2.2 MB/s | 764 kB     00:00    
(13/15): tzdata-java-2024a-1.el8.noarch.rpm                                                                                                  8.9 MB/s | 186 kB     00:00    
(14/15): nss-util-3.101.0-7.el8_8.x86_64.rpm                                                                                                 676 kB/s | 141 kB     00:00    
(15/15): java-11-openjdk-headless-11.0.23.0.9-3.el8.x86_64.rpm                                                                               4.7 MB/s |  42 MB     00:08    
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                        5.0 MB/s |  45 MB     00:09     
Complete!
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'yum clean packages'.
+ sudo yum install --downloadonly --destdir /home/jdoe/ -y https://apache.jfrog.io/artifactory/cassandra-rpm/41x/cassandra-4.1.0-1.noarch.rpm
Last metadata expiration check: 0:29:12 ago on Wed 16 Oct 2024 07:40:24 PM UTC.
Dependencies resolved.
=============================================================================================================================================================================
 Package                                       Architecture               Version                                                     Repository                        Size
=============================================================================================================================================================================
Installing:
 cassandra                                     noarch                     4.1.0-1                                                     @commandline                      48 M
Installing dependencies:
 adwaita-cursor-theme                          noarch                     3.28.0-3.el8                                                appstream                        646 k
 adwaita-icon-theme                            noarch                     3.28.0-3.el8                                                appstream                         11 M
 alsa-lib                                      x86_64                     1.2.10-2.el8                                                appstream                        500 k
 at-spi2-atk                                   x86_64                     2.26.2-1.el8                                                appstream                         89 k
 at-spi2-core                                  x86_64                     2.28.0-1.el8                                                appstream                        169 k
 atk                                           x86_64                     2.28.1-1.el8                                                appstream                        271 k
 avahi-libs                                    x86_64                     0.7-27.el8_10.1                                             baseos                            61 k
 cairo                                         x86_64                     1.15.12-6.el8                                               appstream                        718 k
 cairo-gobject                                 x86_64                     1.15.12-6.el8                                               appstream                         32 k
 colord-libs                                   x86_64                     1.4.2-1.el8                                                 appstream                        236 k
 copy-jdk-configs                              noarch                     4.0-2.el8                                                   appstream                         29 k
 cups-libs                                     x86_64                     1:2.2.6-60.el8_10                                           baseos                           436 k
 dejavu-fonts-common                           noarch                     2.35-7.el8                                                  baseos                            73 k
 dejavu-sans-mono-fonts                        noarch                     2.35-7.el8                                                  baseos                           446 k
 fontconfig                                    x86_64                     2.13.1-4.el8                                                baseos                           273 k
 fontpackages-filesystem                       noarch                     1.44-22.el8                                                 baseos                            16 k
 fribidi                                       x86_64                     1.0.4-9.el8                                                 appstream                         88 k
 gdk-pixbuf2                                   x86_64                     2.36.12-6.el8_10                                            baseos                           465 k
 gdk-pixbuf2-modules                           x86_64                     2.36.12-6.el8_10                                            appstream                        108 k
 glib-networking                               x86_64                     2.56.1-1.1.el8                                              baseos                           155 k
 graphite2                                     x86_64                     1.3.10-10.el8                                               appstream                        121 k
 gsettings-desktop-schemas                     x86_64                     3.32.0-6.el8                                                baseos                           632 k
 gtk-update-icon-cache                         x86_64                     3.22.30-12.el8_10                                           appstream                         31 k
 harfbuzz                                      x86_64                     1.7.5-4.el8                                                 appstream                        295 k
 hicolor-icon-theme                            noarch                     0.17-2.el8                                                  appstream                         48 k
 jasper-libs                                   x86_64                     2.0.14-5.el8                                                appstream                        166 k
 java-11-openjdk                               x86_64                     1:11.0.24.0.8-3.el8                                         appstream                        475 k
 java-11-openjdk-headless                      x86_64                     1:11.0.24.0.8-3.el8                                         appstream                         42 M
 javapackages-filesystem                       noarch                     5.3.0-2.module_el8.0.0+6004+2fc32706                        appstream                         30 k
 jbigkit-libs                                  x86_64                     2.1-14.el8                                                  appstream                         54 k
 json-glib                                     x86_64                     1.4.4-1.el8                                                 baseos                           144 k
 lcms2                                         x86_64                     2.9-2.el8                                                   appstream                        164 k
 libX11                                        x86_64                     1.6.8-9.el8_10                                              appstream                        611 k
 libX11-common                                 noarch                     1.6.8-9.el8_10                                              appstream                        157 k
 libXau                                        x86_64                     1.0.9-3.el8                                                 appstream                         37 k
 libXcomposite                                 x86_64                     0.4.4-14.el8                                                appstream                         28 k
 libXcursor                                    x86_64                     1.1.15-3.el8                                                appstream                         36 k
 libXdamage                                    x86_64                     1.1.4-14.el8                                                appstream                         26 k
 libXext                                       x86_64                     1.3.4-1.el8                                                 appstream                         45 k
 libXfixes                                     x86_64                     5.0.3-7.el8                                                 appstream                         25 k
 libXft                                        x86_64                     2.3.3-1.el8                                                 appstream                         66 k
 libXi                                         x86_64                     1.7.10-1.el8                                                appstream                         48 k
 libXinerama                                   x86_64                     1.1.4-1.el8                                                 appstream                         15 k
 libXrandr                                     x86_64                     1.5.2-1.el8                                                 appstream                         33 k
 libXrender                                    x86_64                     0.9.10-7.el8                                                appstream                         33 k
 libXtst                                       x86_64                     1.2.3-7.el8                                                 appstream                         21 k
 libdatrie                                     x86_64                     0.2.9-7.el8                                                 appstream                         33 k
 libepoxy                                      x86_64                     1.5.8-1.el8                                                 appstream                        224 k
 libfontenc                                    x86_64                     1.1.3-8.el8                                                 appstream                         37 k
 libgusb                                       x86_64                     0.3.0-1.el8                                                 baseos                            49 k
 libjpeg-turbo                                 x86_64                     1.5.3-12.el8                                                appstream                        156 k
 libmodman                                     x86_64                     2.0.1-17.el8                                                baseos                            36 k
 libpkgconf                                    x86_64                     1.4.2-1.el8                                                 baseos                            35 k
 libproxy                                      x86_64                     0.4.15-5.2.el8                                              baseos                            75 k
 libsoup                                       x86_64                     2.62.3-5.el8                                                baseos                           424 k
 libthai                                       x86_64                     0.1.27-2.el8                                                appstream                        203 k
 libtiff                                       x86_64                     4.0.9-32.el8_10                                             appstream                        189 k
 libwayland-client                             x86_64                     1.21.0-1.el8                                                appstream                         40 k
 libwayland-cursor                             x86_64                     1.21.0-1.el8                                                appstream                         25 k
 libwayland-egl                                x86_64                     1.21.0-1.el8                                                appstream                         18 k
 libxcb                                        x86_64                     1.13.1-1.el8                                                appstream                        231 k
 lksctp-tools                                  x86_64                     1.0.18-3.el8                                                baseos                            99 k
 lua                                           x86_64                     5.3.4-12.el8                                                appstream                        191 k
 nspr                                          x86_64                     4.35.0-1.el8_8                                              appstream                        142 k
 nss                                           x86_64                     3.101.0-7.el8_8                                             appstream                        764 k
 nss-softokn                                   x86_64                     3.101.0-7.el8_8                                             appstream                        530 k
 nss-softokn-freebl                            x86_64                     3.101.0-7.el8_8                                             appstream                        391 k
 nss-sysinit                                   x86_64                     3.101.0-7.el8_8                                             appstream                         75 k
 nss-util                                      x86_64                     3.101.0-7.el8_8                                             appstream                        141 k
 pango                                         x86_64                     1.42.4-8.el8                                                appstream                        296 k
 pixman                                        x86_64                     0.38.4-4.el8                                                appstream                        257 k
 pkgconf                                       x86_64                     1.4.2-1.el8                                                 baseos                            38 k
 pkgconf-m4                                    noarch                     1.4.2-1.el8                                                 baseos                            17 k
 pkgconf-pkg-config                            x86_64                     1.4.2-1.el8                                                 baseos                            15 k
 rest                                          x86_64                     0.8.1-2.el8                                                 appstream                         70 k
 ttmkfdir                                      x86_64                     3.0.9-54.el8                                                appstream                         62 k
 tzdata-java                                   noarch                     2024a-1.el8                                                 appstream                        186 k
 xorg-x11-font-utils                           x86_64                     1:7.5-41.el8                                                appstream                        102 k
 xorg-x11-fonts-Type1                          noarch                     7.5-19.el8                                                  appstream                        522 k
Installing weak dependencies:
 abattis-cantarell-fonts                       noarch                     0.0.25-6.el8                                                appstream                        154 k
 dconf                                         x86_64                     0.28.0-4.el8                                                appstream                        107 k
 gtk3                                          x86_64                     3.22.30-12.el8_10                                           appstream                        4.5 M

Transaction Summary
=============================================================================================================================================================================
Install  83 Packages

Total size: 120 M
Total download size: 68 M
Installed size: 319 M
YUM will only download packages for the transaction.
Downloading Packages:
[SKIPPED] avahi-libs-0.7-27.el8_10.1.x86_64.rpm: Already downloaded                                                                                                         
[SKIPPED] cups-libs-2.2.6-60.el8_10.x86_64.rpm: Already downloaded                                                                                                          
[SKIPPED] lksctp-tools-1.0.18-3.el8.x86_64.rpm: Already downloaded                                                                                                          
[SKIPPED] alsa-lib-1.2.10-2.el8.x86_64.rpm: Already downloaded                                                                                                              
[SKIPPED] copy-jdk-configs-4.0-2.el8.noarch.rpm: Already downloaded                                                                                                         
[SKIPPED] javapackages-filesystem-5.3.0-2.module_el8.0.0+6004+2fc32706.noarch.rpm: Already downloaded                                                                       
[SKIPPED] lua-5.3.4-12.el8.x86_64.rpm: Already downloaded                                                                                                                   
[SKIPPED] nspr-4.35.0-1.el8_8.x86_64.rpm: Already downloaded                                                                                                                
[SKIPPED] nss-3.101.0-7.el8_8.x86_64.rpm: Already downloaded                                                                                                                
[SKIPPED] nss-softokn-3.101.0-7.el8_8.x86_64.rpm: Already downloaded                                                                                                        
[SKIPPED] nss-softokn-freebl-3.101.0-7.el8_8.x86_64.rpm: Already downloaded                                                                                                 
[SKIPPED] nss-sysinit-3.101.0-7.el8_8.x86_64.rpm: Already downloaded                                                                                                        
[SKIPPED] nss-util-3.101.0-7.el8_8.x86_64.rpm: Already downloaded                                                                                                           
[SKIPPED] tzdata-java-2024a-1.el8.noarch.rpm: Already downloaded                                                                                                            
(15/82): dejavu-fonts-common-2.35-7.el8.noarch.rpm                                                                                           3.6 MB/s |  73 kB     00:00    
(16/82): fontpackages-filesystem-1.44-22.el8.noarch.rpm                                                                                      2.3 MB/s |  16 kB     00:00    
(17/82): fontconfig-2.13.1-4.el8.x86_64.rpm                                                                                                  8.6 MB/s | 273 kB     00:00    
(18/82): dejavu-sans-mono-fonts-2.35-7.el8.noarch.rpm                                                                                         11 MB/s | 446 kB     00:00    
(19/82): glib-networking-2.56.1-1.1.el8.x86_64.rpm                                                                                           8.1 MB/s | 155 kB     00:00    
(20/82): gdk-pixbuf2-2.36.12-6.el8_10.x86_64.rpm                                                                                              16 MB/s | 465 kB     00:00    
(21/82): libgusb-0.3.0-1.el8.x86_64.rpm                                                                                                      5.0 MB/s |  49 kB     00:00    
(22/82): json-glib-1.4.4-1.el8.x86_64.rpm                                                                                                    7.7 MB/s | 144 kB     00:00    
(23/82): gsettings-desktop-schemas-3.32.0-6.el8.x86_64.rpm                                                                                    19 MB/s | 632 kB     00:00    
(24/82): libmodman-2.0.1-17.el8.x86_64.rpm                                                                                                   4.5 MB/s |  36 kB     00:00    
(25/82): libpkgconf-1.4.2-1.el8.x86_64.rpm                                                                                                   4.4 MB/s |  35 kB     00:00    
(26/82): libproxy-0.4.15-5.2.el8.x86_64.rpm                                                                                                  6.2 MB/s |  75 kB     00:00    
(27/82): pkgconf-1.4.2-1.el8.x86_64.rpm                                                                                                      4.6 MB/s |  38 kB     00:00    
(28/82): pkgconf-m4-1.4.2-1.el8.noarch.rpm                                                                                                   2.6 MB/s |  17 kB     00:00    
(29/82): pkgconf-pkg-config-1.4.2-1.el8.x86_64.rpm                                                                                           2.4 MB/s |  15 kB     00:00    
(30/82): libsoup-2.62.3-5.el8.x86_64.rpm                                                                                                      17 MB/s | 424 kB     00:00    
(31/82): abattis-cantarell-fonts-0.0.25-6.el8.noarch.rpm                                                                                     8.8 MB/s | 154 kB     00:00    
(32/82): adwaita-cursor-theme-3.28.0-3.el8.noarch.rpm                                                                                         21 MB/s | 646 kB     00:00    
(33/82): at-spi2-atk-2.26.2-1.el8.x86_64.rpm                                                                                                 6.1 MB/s |  89 kB     00:00    
(34/82): at-spi2-core-2.28.0-1.el8.x86_64.rpm                                                                                                8.9 MB/s | 169 kB     00:00    
(35/82): atk-2.28.1-1.el8.x86_64.rpm                                                                                                          13 MB/s | 271 kB     00:00    
(36/82): cairo-gobject-1.15.12-6.el8.x86_64.rpm                                                                                              4.0 MB/s |  32 kB     00:00    
(37/82): cairo-1.15.12-6.el8.x86_64.rpm                                                                                                       25 MB/s | 718 kB     00:00    
(38/82): colord-libs-1.4.2-1.el8.x86_64.rpm                                                                                                   12 MB/s | 236 kB     00:00    
(39/82): dconf-0.28.0-4.el8.x86_64.rpm                                                                                                       7.0 MB/s | 107 kB     00:00    
(40/82): fribidi-1.0.4-9.el8.x86_64.rpm                                                                                                      6.3 MB/s |  88 kB     00:00    
(41/82): gdk-pixbuf2-modules-2.36.12-6.el8_10.x86_64.rpm                                                                                      15 MB/s | 108 kB     00:00    
(42/82): gtk-update-icon-cache-3.22.30-12.el8_10.x86_64.rpm                                                                                  7.8 MB/s |  31 kB     00:00    
(43/82): graphite2-1.3.10-10.el8.x86_64.rpm                                                                                                  7.6 MB/s | 121 kB     00:00    
(44/82): harfbuzz-1.7.5-4.el8.x86_64.rpm                                                                                                      11 MB/s | 295 kB     00:00    
(45/82): hicolor-icon-theme-0.17-2.el8.noarch.rpm                                                                                            4.3 MB/s |  48 kB     00:00    
(46/82): jasper-libs-2.0.14-5.el8.x86_64.rpm                                                                                                  20 MB/s | 166 kB     00:00    
(47/82): gtk3-3.22.30-12.el8_10.x86_64.rpm                                                                                                    65 MB/s | 4.5 MB     00:00    
(48/82): adwaita-icon-theme-3.28.0-3.el8.noarch.rpm                                                                                           63 MB/s |  11 MB     00:00    
(49/82): jbigkit-libs-2.1-14.el8.x86_64.rpm                                                                                                  5.1 MB/s |  54 kB     00:00    
(50/82): lcms2-2.9-2.el8.x86_64.rpm                                                                                                           23 MB/s | 164 kB     00:00    
(51/82): libX11-1.6.8-9.el8_10.x86_64.rpm                                                                                                     78 MB/s | 611 kB     00:00    
(52/82): libX11-common-1.6.8-9.el8_10.noarch.rpm                                                                                              30 MB/s | 157 kB     00:00    
(53/82): libXau-1.0.9-3.el8.x86_64.rpm                                                                                                       9.1 MB/s |  37 kB     00:00    
(54/82): libXcomposite-0.4.4-14.el8.x86_64.rpm                                                                                               8.1 MB/s |  28 kB     00:00    
(55/82): libXcursor-1.1.15-3.el8.x86_64.rpm                                                                                                  9.8 MB/s |  36 kB     00:00    
(56/82): libXdamage-1.1.4-14.el8.x86_64.rpm                                                                                                  7.5 MB/s |  26 kB     00:00    
(57/82): libXext-1.3.4-1.el8.x86_64.rpm                                                                                                      9.4 MB/s |  45 kB     00:00    
(58/82): libXfixes-5.0.3-7.el8.x86_64.rpm                                                                                                    7.3 MB/s |  25 kB     00:00    
(59/82): libXft-2.3.3-1.el8.x86_64.rpm                                                                                                        15 MB/s |  66 kB     00:00    
(60/82): libXi-1.7.10-1.el8.x86_64.rpm                                                                                                        12 MB/s |  48 kB     00:00    
(61/82): libXinerama-1.1.4-1.el8.x86_64.rpm                                                                                                  4.4 MB/s |  15 kB     00:00    
(62/82): libXrandr-1.5.2-1.el8.x86_64.rpm                                                                                                    9.7 MB/s |  33 kB     00:00    
(63/82): libXrender-0.9.10-7.el8.x86_64.rpm                                                                                                  9.2 MB/s |  33 kB     00:00    
(64/82): libXtst-1.2.3-7.el8.x86_64.rpm                                                                                                      6.3 MB/s |  21 kB     00:00    
(65/82): libdatrie-0.2.9-7.el8.x86_64.rpm                                                                                                    9.6 MB/s |  33 kB     00:00    
(66/82): libepoxy-1.5.8-1.el8.x86_64.rpm                                                                                                      39 MB/s | 224 kB     00:00    
(67/82): libfontenc-1.1.3-8.el8.x86_64.rpm                                                                                                    10 MB/s |  37 kB     00:00    
(68/82): libjpeg-turbo-1.5.3-12.el8.x86_64.rpm                                                                                                28 MB/s | 156 kB     00:00    
(69/82): libthai-0.1.27-2.el8.x86_64.rpm                                                                                                      35 MB/s | 203 kB     00:00    
(70/82): libtiff-4.0.9-32.el8_10.x86_64.rpm                                                                                                   32 MB/s | 189 kB     00:00    
(71/82): libwayland-client-1.21.0-1.el8.x86_64.rpm                                                                                            10 MB/s |  40 kB     00:00    
(72/82): libwayland-cursor-1.21.0-1.el8.x86_64.rpm                                                                                           7.6 MB/s |  25 kB     00:00    
(73/82): libwayland-egl-1.21.0-1.el8.x86_64.rpm                                                                                              5.4 MB/s |  18 kB     00:00    
(74/82): libxcb-1.13.1-1.el8.x86_64.rpm                                                                                                       38 MB/s | 231 kB     00:00    
(75/82): pango-1.42.4-8.el8.x86_64.rpm                                                                                                        49 MB/s | 296 kB     00:00    
(76/82): pixman-0.38.4-4.el8.x86_64.rpm                                                                                                       44 MB/s | 257 kB     00:00    
(77/82): rest-0.8.1-2.el8.x86_64.rpm                                                                                                          11 MB/s |  70 kB     00:00    
(78/82): ttmkfdir-3.0.9-54.el8.x86_64.rpm                                                                                                     15 MB/s |  62 kB     00:00    
(79/82): xorg-x11-font-utils-7.5-41.el8.x86_64.rpm                                                                                            19 MB/s | 102 kB     00:00    
(80/82): xorg-x11-fonts-Type1-7.5-19.el8.noarch.rpm                                                                                           66 MB/s | 522 kB     00:00    
(81/82): java-11-openjdk-11.0.24.0.8-3.el8.x86_64.rpm                                                                                        415 kB/s | 475 kB     00:01    
(82/82): java-11-openjdk-headless-11.0.24.0.8-3.el8.x86_64.rpm                                                                               3.4 MB/s |  42 MB     00:12    
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                        5.3 MB/s |  68 MB     00:12     
Complete!
The downloaded packages were saved in cache until the next successful transaction.
You can remove cached packages by executing 'yum clean packages'.
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$ 

2.2 - Apache Zookeeper

Step 2.2.1 - Download Zookeeper via the command below:

...

Expand
titleApache Zookeeper `./syndeia-cloud-3.6_zookeeper_pre-setup.bash -d` sample output
Code Block
languagebash
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$ ./syndeia-cloud-3.6_zookeeper_pre-setup.bash -d
+ shopt -s extglob
+ shopt -s globstar
++ readlink -f ./syndeia-cloud-3.6_zookeeper_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin/syndeia-cloud-3.6_zookeeper_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01
+ SC_version_parsed=3.6-SP1.2024-10-01
+ SC_version=3.6-SP1.2024-10-01
+ service_name=zookeeper
+ ZK_build_ver=3.8.4
++ uname
+ OS=Linux
+ [[ Linux =~ CYGWIN ]]
+ systemctl=systemctl
+ sudo=sudo
+ ln='ln -nfs'
+ ZK_upgrade=false
+ [[ -e /opt/zookeeper-current ]]
+ umask 0002
+ pushd .
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin ~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin
+ cd /home/jdoe/
+ [[ -d == \-\d ]]
+ wget https://archive.apache.org/dist/zookeeper/zookeeper-3.8.4/apache-zookeeper-3.8.4-bin.tar.gz -O zookeeper-3.8.4-bin.tar.gz
--2024-10-16 15:23:48--  https://archive.apache.org/dist/zookeeper/zookeeper-3.8.4/apache-zookeeper-3.8.4-bin.tar.gz
Resolving archive.apache.org (archive.apache.org)... 2a01:4f9:1a:a084::2, 65.108.204.189
Connecting to archive.apache.org (archive.apache.org)|2a01:4f9:1a:a084::2|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 14609453 (14M) [application/x-gzip]
Saving to: ‘zookeeper-3.8.4-bin.tar.gz’

zookeeper-3.8.4-bin.tar.gz                  100%[========================================================================================>]  13.93M  6.14MB/s    in 2.3s    

2024-10-16 15:23:51 (6.14 MB/s) - ‘zookeeper-3.8.4-bin.tar.gz’ saved [14609453/14609453]

~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$

2.3 - Apache Kafka

Step 2.3.1 - Download Kafka via the command below:

...

Expand
titleApache Kafka `./syndeia-cloud-3.6_kafka_pre-setup.bash -d` sample output
Code Block
languagebash
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$ ./syndeia-cloud-3.6_kafka_pre-setup.bash -d
+ shopt -s extglob
+ shopt -s globstar
++ readlink -f ./syndeia-cloud-3.6_kafka_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin/syndeia-cloud-3.6_kafka_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01
+ SC_version_parsed=3.6-SP1.2024-10-01
+ SC_version=3.6-SP1.2024-10-01
+ service_name=kafka
+ Scala_ver=2.13
+ Kafka_build_ver=3.7.0
++ uname
+ OS=Linux
+ [[ Linux =~ CYGWIN ]]
+ systemctl=systemctl
+ sudo=sudo
+ ln='ln -nfs'
+ Kafka_upgrade=false
+ [[ -e /opt/kafka-current ]]
+ umask 0002
+ pushd .
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin ~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin
+ cd /home/jdoe/
+ [[ -d == \-\d ]]
+ wget https://archive.apache.org/dist/kafka/3.7.0/kafka_2.13-3.7.0.tgz
--2024-10-16 15:26:05--  https://archive.apache.org/dist/kafka/3.7.0/kafka_2.13-3.7.0.tgz
Resolving archive.apache.org (archive.apache.org)... 2a01:4f9:1a:a084::2, 65.108.204.189
Connecting to archive.apache.org (archive.apache.org)|2a01:4f9:1a:a084::2|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 119028138 (114M) [application/x-gzip]
Saving to: ‘kafka_2.13-3.7.0.tgz’

kafka_2.13-3.7.0.tgz                        100%[========================================================================================>] 113.51M  26.9MB/s    in 5.0s    

2024-10-16 15:26:11 (22.8 MB/s) - ‘kafka_2.13-3.7.0.tgz’ saved [119028138/119028138]

~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$

2.4 - JanusGraph

Step 2.4.1 - Download JanusGraph via the two commands below:

...

Expand
titleJanusGraph `./syndeia-cloud-3.6_janusgraph_pre-setup.bash -d` sample output
Code Block
languagebash
~/syndeia-cloud-3.6-SP1.2024-10-01_cassandra_zookeeper_kafka_setup/bin$ ./syndeia-cloud-3.6_janusgraph_pre-setup.bash -d
+ shopt -s extglob
+ shopt -s globstar
+++ dirname ./syndeia-cloud-3.6_janusgraph_pre-setup.bash
++ cd -P .
++ pwd
+ SCRIPT_DIR=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01_janusgraph_setup/bin
++ readlink -f ./syndeia-cloud-3.6_janusgraph_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01_janusgraph_setup/bin/syndeia-cloud-3.6_janusgraph_pre-setup.bash
+ SC_version_parsed=/home/jdoe/syndeia-cloud-3.6-SP1.2024-10-01
+ SC_version_parsed=3.6-SP1.2024-10-01
+ SC_version=3.6-SP1.2024-10-01
+ service_name=janusgraph
+ JG_build_ver=1.0.0
++ uname
+ OS=Linux
+ [[ Linux =~ CYGWIN ]]
+ systemctl=systemctl
+ sudo=sudo
+ ln='ln -nfs'
+ JG_upgrade=false
+ [[ -e /opt/janusgraph-current ]]
+ umask 0002
+ pushd .
~/syndeia-cloud-3.6-SP1.2024-10-01_janusgraph_setup/bin ~/syndeia-cloud-3.6-SP1.2024-10-01_janusgraph_setup/bin
+ cd /home/jdoe/
+ [[ -d == \-\d ]]
+ wget https://github.com/JanusGraph/janusgraph/releases/download/v1.0.0/janusgraph-full-1.0.0.zip
--2024-10-16 15:34:51--  https://github.com/JanusGraph/janusgraph/releases/download/v1.0.0/janusgraph-full-1.0.0.zip
Resolving github.com (github.com)... 140.82.114.4
Connecting to github.com (github.com)|140.82.114.4|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/77385607/4db62a12-dfef-4589-adba-f1ed3564af56?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20241016%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20241016T193452Z&X-Amz-Expires=300&X-Amz-Signature=2d318392b1b2d342639076ea7e723a6e22b9749ed8661e479dbbc8d12fd76618&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Djanusgraph-full-1.0.0.zip&response-content-type=application%2Foctet-stream [following]
--2024-10-16 15:34:52--  https://objects.githubusercontent.com/github-production-release-asset-2e65be/77385607/4db62a12-dfef-4589-adba-f1ed3564af56?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20241016%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20241016T193452Z&X-Amz-Expires=300&X-Amz-Signature=2d318392b1b2d342639076ea7e723a6e22b9749ed8661e479dbbc8d12fd76618&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Djanusgraph-full-1.0.0.zip&response-content-type=application%2Foctet-stream
Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.111.133, ...
Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 743882909 (709M) [application/octet-stream]
Saving to: ‘janusgraph-full-1.0.0.zip’

janusgraph-full-1.0.0.zip                   100%[========================================================================================>] 709.42M   202MB/s    in 3.5s    

2024-10-16 15:34:55 (205 MB/s) - ‘janusgraph-full-1.0.0.zip’ saved [743882909/743882909]

+ [[ Linux =~ CYGWIN ]]
~/syndeia-cloud-3.6-SP1.2024-10-01_janusgraph_setup/bin$

3. Copy files

Step 3.1 - Copy over all the downloaded items in the previous steps along with syndeia-cloud-3.6-SP1*.zip files to the home folder of the target machine in your secure enclave / SCIF / air-gapped environment where Syndeia Cloud will be deployed.

...

Limitations

Windows

Cassandra version 4+, a requirement for Syndeia Cloud 3.6 SP1, is no longer supported on Windows. Users running Syndeia Cloud on Windows are encouraged to migrate to a Linux instance. If continuing on Windows is necessary, virtualization and Docker solutions can be used to upgrade to 3.6 SP1. Supporting documentation is available at request for this scenario as well. For additional help, users should submit a help ticket for engineering support.