[jdoe@new-server bin]$ ./syndeia-cloud-3.6_install.bash
OVERVIEW: This script will install, configure, and start all Syndeia Cloud (SC) 3.6 services for a single-node deployment (multi-node deployment will require some additional customization).
GENERAL USAGE: syndeia-cloud-3.6_install.bash [--kafka_version=|-k_v <KAFKA_version>] [--SC_version=|-SC_v <SC_version>] [--skip_devops|-s] [--upgrade[_new_conf]|-u[_nc]] [--multi_node|-m] [--super_user_pw=|-su_pw <super_user_pw>] [--automated|-a] [--verbose|-v] [--debug|-d]
... where:
[<KAFKA_version>] = optional KAFKA version, defaults to "current" if unspecified
[<SC_version>] = optional, Syndeia Cloud version, defaults to 3.6 if unspecified
[--upgrade|-u] = optional, default is to drop existing keyspaces, run devops actions at end, & archive Kafka logs; if enabled, this will keep existing keyspaces & omit the following: running super.user devops action + Kafka log archiving
[--upgrade_new_conf|-u_nc] = optional, same as --upgrade|-u except use new conf files and copy in old for manual merging, any 3rd-party libs files will also need to be manually reinstalled (NOTE, keystore will still be copied over if it exists but you will need to manually re-enable it in the web-gateway's application.conf)
[--skip_devops|-s] = optional, default is run devops actions; if enabled, this will skip running the devops actions at the end
[--multi_node|-m] = optional, default is to assume single-node; if enabled, this will patch systemd .service files to not assume a single-node topology deployment
[--super_user_pw|-su_pw] = optional, switch to specify the super.user password if it has been changed
[--automated|-a] = optional, default is to run in (mostly) interactive mode; if enabled, this will run non-interactively and use exported environment vars instead, if any (see sc_automated_settings-rc template file)
[--verbose] = optional, default is off, if enabled, zip extractions will list all files extracted
[--debug] = optional, default is off, if enabled, all services are launched via a screen session with multiple windows to tail the logs, also enables JMX (WARNING: requires first setting up JVM's JMX auth (see https://docs.oracle.com/en/java/javase/11/management/monitoring-and-management-using-jmx-technology.html#GUID-805517EC-2D33-4D61-81D8-4D0FA770D1B8)), JMX port #s listed under "JMX port definitions:"
In interactive mode you will be prompted for the following:
- your syndeia_admin password,
- Cassandra/JanusGraph (JG) hostname,
- Apache Kafka hostname,
- Apache Kafka installed path,
- Syndeia Cloud (SC) hostname
(i) Note: you may be also prompted for sudo authentication
DETAIL: Specifically this script will:
- install Syndeia Cloud 3.6 to /opt/icx/syndeia-cloud-3.6 (default),
- make syndeia-cloud:syndeia-cloud the owner,
- configure the application.conf files if necessary,
- generate a concatenated schema file,
- stop any existing Syndeia Cloud 3.6, 3.5, 3.4, 3.3, or 3.2 processes,
- update/create a "current" symlink to the installed version,
- stop the Janusgraph service,
- stop the Kafka service,
- archive any old Kafka logs,
- drop any old keyspaces & generate the new schema in the DB (Cassandra),
- start Kafka service,
- start Janusgraph service,
- install a tmpfiles.d .conf file for syndeia-cloud,
- install sudoers file for syndeia-cloud,
- install systemd .target and .service files for syndeia-cloud microservices
- start all Syndeia Cloud microservices,
- create the superuser account, and
- create some sample test data.
REQUIREMENTS: BASH v4.4.12(1)+
+ Apache Cassandra 3.11.13+ installed and running
+ JanusGraph 0.5.3 installed (WILL NOT WORK WITH 0.6+)
+ Apache Zookeeper 3.6.3+ + installed and running
+ Apache Kafka 2.13-3.2.1+ installed
+ systemd 219+
+ systemd .service files installed for {Cassandra,JanusGraph,Kafka}
+ GNU sed 4.2.2+
+ GNU tr 8.2.2+ (part of GNU coreutils)
+ Info-Zip unzip 6.0+
(+ GNU screen 4.03.01+ installed, only for debug mode)
VERSIONS:
2019-06-10, BKM: v0.1: Initial
2019-12-10, BKM: v0.9: Small fixes
2020-01-22, BKM: v1.1: Update for SC 3.4
2020-01-22, BKM: v1.2: Update for SC 3.4: add new services: confluence, github, twc(loud), wc
2020-08-17, BKM: v1.3: Update for SC 3.4: add new services: bitbucket, gitlab; re-number ports
2019-09-24, BKM: v1.4: Small updates (ported improvements from 3.3 script, fixed comments/messages)
2020-10-14, BKM: v1.5: Update for SC 3.4: add new services: aras; re-number ports; remove extraneous comments
2020-10-21, BKM: v1.6: Update for SC 3.4: add new services: sysmlv2
2020-10-28, BKM: v1.7: Update for SC 3.4: add new services: testrail
2020-11-19, BKM: v1.8: Update for SC 3.4: add new services: doors
2021-01-06, BKM: v1.9: Update for SC 3.4-v2: add --upgrade|-u option
2021-01-13, BKM: v2.0: sc-auth.service: sed replace localhost with what user specifies during install; upgrade: keep Kafka logs also
2021-01-13, BKM: v2.1: Update for SC 3.4: add new services: artifactory
2021-01-14, BKM: v2.2: Update for SC 3.4: add --skip_devops action option
2021-01-21, BKM: v2.3: Update for SC 3.4: chown /opt/icx vs just /opt/icx/syndeia-cloud-<version>, disable SC 3.2 service if exists; fix skip_devops check
2021-04-02, BKM: v2.4: Update for SC 3.4: add --upgrade_new_conf|-u_nc to not copy in old conf file settings
2021-04-02, BKM: v2.4: Update for SC 3.4: add -q to zip extractions by default, add --verbose|-v option (currently only makes zip more verbose, ie: remove -q, and silences grep confirmation output), make unzips more precise to avoid "cautions" also
2021-05-25, BKM: v2.5: Update for SC 3.4: Make "1.0-SNAPSHOT" a variable
2021-05-31, BKM: v2.6: Update for SC 3.4: add --automated|-a action option for running non-interactively + template for environment vars that can be set (see sc_automated_settings-rc); quote services wildcard: 'sc-*'
2021-09-29, BKM: v2.9: SC 3.4.1 (SP1): change hardcoded /opt/kafka-current to KAFKA_HOME (some customers have non-standard custom installation path requirements to /opt/local vs /opt)
2021-10-05, BKM: v3.0: SC 3.4.1 (SP1): SYN-2336, SYN-2330: extract out janusconfigurationString.yaml too, add support for dual/multi-node deployment topologies (--multi_node|-m): configure janusconfiguration{,String}.yaml with jg_host + syndeia_admin_pw + update installed .service & .target files
2021-10-06, BKM: v3.1: SC 3.4.1 (SP1): SYN-2345: fix --upgrade|-u as it doesn't properly copy over old .conf files when snapshot version changes
2021-10-14, BKM: v3.2: SC 3.4.1 (SP1): tweak all_files_exist() logic
2021-11-15, BKM: v3.3: SC 3.5: add PLAY_SECRET since Lagom v1.6.5 seems to now require setting it something more complicated than "whatever"
2022-01-11, BKM: v3.4: SC 3.5: SYN-2336, SYN-2330: add support for dual/multi-node deployment topologies (--multi_node|-m): configure janusconfiguration{,String}.yaml with jg_host + syndeia_admin_pw + update installed .service & .target files
2022-01-27, BKM: v3.5: SC 3.5: add new services: volta
2022-01-21, BKM: v3.6: SC 3.5: add SC_snapshot_version_old, defaults to 3.4-SP1, use in --upgrade|-u and --upgrade_new_conf|-u_nc mode (previous implementation was only useful for development testing)
2022-03-11, BKM: v3.7: SC 3.5: add new services: collaborator
2022-03-24, BKM: v3.8: SC 3.5: SYN-2449: switch to using build provided /conf/ files by default except for select services
2022-03-25, BKM: v3.9: SC 3.5: SYN-2550: SC: 1. setup doesn't take into account different SC_snapshot_versions when upgrading
2022-04-18, BKM: v3.10: SC 3.5: Make SC services start on boot
2022-04-28, BKM: v3.11: SC 3.5: SYN-2444: add timestamps to log output
2022-05-18, BKM: v3.12: SC 3.5: SYN-2470: add support for new 'restful' service
2022-06-21, BKM: v3.13: SC 3.5: Set SC_snapshot_version_old default to 3.4-SP3
2022-08-18, BKM: v3.14: SC 3.5: SYN-2444, SYN-2752: Remove unused social auth providers, remove existing closing brace before EOF, add new LDAP group settings, add new SAML2 settings
2022-08-23, BKM: v3.15: SC 3.5: SYN-2444, SYN-2752, SYN-2851: --upgrade|-u: Update web-gateway's application.conf settings to add all new services from 3.4-SP3, set PLAY_SECRET, update play.filters.headers.contentSecurityPolicy, add play.filters.headers.allowActionSpecificHeaders = true, make LDAP Group + SAML upgrade sections more idempotent
2022-08-24, BKM: v3.16: SC 3.5: SYN-2848, SYN-2850 (PR #743, PR #744): fresh install + --upgrade|-u: implement corresponding changes to setup new or upgrade LDAP(S) settings
2022-08-26, BKM: v3.17: SC 3.5: SYN-2855: --upgrade|-u || --upgrade_new_conf|-u_nc: make this now run setup action since 3.4 to 3.5 introduced new integrations
2022-08-31, BKM: v4.0: SC 3.5: SYN-2858: remove dead code dealing with unnecessary stopping/starting of JG service (legacy artifact from when JG setup was part of this setup)
2022-11-30, BKM: v4.1: SC 3.6: Bump up to 3.6
2022-11-09, BKM: v4.2: SC 3.6: SYN-2917: SC setup update for password to sc-graph's janusconfiguration.yaml and janusconfigurationString.yaml should be less fragile.
2023-03-20, BKM: v4.3: SC 3.6: Update more 3.5 refs to 3.6
2023-03-20, BKM: v4.3: SC 3.6: SYN-3762: add support for new (NON-RESTful) DSE3 service
2023-04-19, KP: v4.4: SC 3.6: SYN-3847: add support for new genesys service
2023-04-19, KP: v4.5: SC 3.6: SYN-3848: add support for new (NON-RESTful) teamcenter service
2023-06-06, BKM: v4.6: SC 3.6: SYN-3166: Advanced Topologies: add support where kafka may not be on localhost
2023-06-27, KP: v4.7: SC 3.6: SYN-3944: add support for new dscr service
2023-06-27, KP: v4.8: SC 3.6: SYN-4141: add support for new digital-thread service
2024-03-05, BKM: v4.9: SC 3.6: SYN-4259: add support for porting devops configuration when HTTPS is enabled
2024-08-23, BKM: v5.0: SC 3.6-SP1: SYN-4794: add support for porting 3rd-party libs during upgrades
[press any key to when ready or hit ^C to cancel]
- Enter password for the Cassandra syndeia_admin user created during JanusGraph setup: ***REDACTED***
- Enter Cassandra host / FQDN, ie: cassandra.mydomain.com, localhost, etc.: localhost
- Enter JanusGraph host / FQDN, ie: jg.mydomain.com, localhost, etc.: localhost
- Enter Apache Kafka host / FQDN, ie: kafka.mydomain.com, localhost, etc.: localhost
- Enter Apache Kafka installed path, ie: /opt/kafka-current: /opt/kafka-current
- Do you wish to configure LDAP? [y|n]:
1) Y
2) N
#? n
- Enter Syndeia Cloud (SC) host / FQDN used for port check, ie: localhost, cassandra.mydomain.com, syndeia-cloud33.mydomain.com, sc33.mydomain.com, etc.: localhost
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Checking if any SC 3.2 service file exist...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Checking if any SC 3.3/3.4/3.5/3.6 service files exist...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - /etc/systemd/system/sc-store.service not found
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - /etc/systemd/system/sc-store.service not found
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - /etc/systemd/system/sc-store.service not found
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - /etc/systemd/system/sc-store.service not found
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Check if any "syndeia-cloud" (debug) processes exist...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud not detected running.
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Now creating install dir...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzip sub-packages...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping aras-impl-3.6-SP1.zip...
Mon Sep 30 12:53:12 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping artifactory-impl-3.6-SP1.zip...
Mon Sep 30 12:53:13 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping auth-impl-3.6-SP1.zip...
Mon Sep 30 12:53:14 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping bitbucket-impl-3.6-SP1.zip...
Mon Sep 30 12:53:14 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping collaborator-impl-3.6-SP1.zip...
Mon Sep 30 12:53:15 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping confluence-impl-3.6-SP1.zip...
Mon Sep 30 12:53:16 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping devops-3.6-SP1.zip...
Mon Sep 30 12:53:16 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping digital-thread-impl-3.6-SP1.zip...
Mon Sep 30 12:53:17 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping doors-impl-3.6-SP1.zip...
Mon Sep 30 12:53:18 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping dscr-impl-3.6-SP1.zip...
Mon Sep 30 12:53:18 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping dse3-impl-3.6-SP1.zip...
Mon Sep 30 12:53:19 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping genesys-impl-3.6-SP1.zip...
Mon Sep 30 12:53:20 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping github-impl-3.6-SP1.zip...
Mon Sep 30 12:53:20 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping gitlab-impl-3.6-SP1.zip...
Mon Sep 30 12:53:21 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping graph-impl-3.6-SP1.zip...
Mon Sep 30 12:53:22 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping jama-impl-3.6-SP1.zip...
Mon Sep 30 12:53:22 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping jira-impl-3.6-SP1.zip...
Mon Sep 30 12:53:23 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping restful-impl-3.6-SP1.zip...
Mon Sep 30 12:53:24 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping store-impl-3.6-SP1.zip...
Mon Sep 30 12:53:25 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping SyndeiaCloudCycloneDxBoms_3.6-SP1.zip...
Mon Sep 30 12:53:25 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping sysmlv2-impl-3.6-SP1.zip...
Mon Sep 30 12:53:25 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping teamcenter-impl-3.6-SP1.zip...
Mon Sep 30 12:53:26 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping teamworkcloud-impl-3.6-SP1.zip...
Mon Sep 30 12:53:27 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping testrail-impl-3.6-SP1.zip...
Mon Sep 30 12:53:27 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping volta-impl-3.6-SP1.zip...
Mon Sep 30 12:53:28 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping web-gateway-3.6-SP1.zip...
Mon Sep 30 12:53:30 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping windchill-impl-3.6-SP1.zip...
Mon Sep 30 12:53:30 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzip web-gateway conf files as text...
Mon Sep 30 12:53:30 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Take recursive ownership of install dir...
Mon Sep 30 12:53:30 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Create logs folder + store-impl auth-impl graph-impl aras-impl artifactory-impl bitbucket-impl collaborator-impl confluence-impl digital-thread-impl doors-impl dscr-impl dse3-impl jama-impl jira-impl genesys-impl github-impl gitlab-impl restful-impl sysmlv2-impl teamcenter-impl teamworkcloud-impl testrail-impl volta-impl windchill-impl service conf folders...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzip store-impl auth-impl graph-impl aras-impl artifactory-impl bitbucket-impl collaborator-impl confluence-impl digital-thread-impl doors-impl dscr-impl dse3-impl jama-impl jira-impl genesys-impl github-impl gitlab-impl restful-impl sysmlv2-impl teamcenter-impl teamworkcloud-impl testrail-impl volta-impl windchill-impl conf files as text...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping store-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping auth-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping graph-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping aras-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping artifactory-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping bitbucket-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping collaborator-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping confluence-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping digital-thread-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping doors-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping dscr-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping dse3-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping jama-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping jira-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping genesys-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping github-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping gitlab-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping restful-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping sysmlv2-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping teamcenter-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping teamworkcloud-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping testrail-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping volta-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping windchill-impl conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzipping devops conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Setting lagom.circuit-breaker call-timeout = 120 seconds in auth service's application.conf to avoid circuit breaker timeouts...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Unzip graph service's JanusGraph configuration .yaml file as text...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Configure all services' application.conf files...
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - setup_LDAP is false and/or upgrade is true: LDAP settings will not be updated in silhouette.conf from build
Mon Sep 30 12:53:31 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Generate concatenated gen-schema.cql file...
Mon Sep 30 12:53:32 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Apache Kafka installed locally, stopping Kafka to archive any previous logs, if any...
Mon Sep 30 12:53:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - tar old Apache Kafka logs folder (to prevent any interference if this is a re-install)...
Mon Sep 30 12:53:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: -
tar: Removing leading `/' from member names
Mon Sep 30 12:53:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Drop old keyspaces and import concatenated schema...
Warning: Using a password on the command line interface can be insecure.
Recommendation: use the credentials file to securely provide the password.
Warnings :
Role 'syndeia_admin' was already granted CREATE, ALTER, DROP, SELECT, MODIFY, AUTHORIZE on <keyspace syndeia_cloud_graph>
Warnings :
Role 'syndeia_admin' was already granted CREATE, ALTER, DROP, SELECT, MODIFY, AUTHORIZE on <keyspace syndeia_cloud_graph_config>
Warnings :
Role 'syndeia_admin' was already granted CREATE, ALTER, DROP, SELECT, MODIFY, AUTHORIZE on <keyspace syndeia_cloud_store>
Warnings :
SASI indexes are experimental and are not recommended for production use.
Warnings :
Role 'syndeia_admin' was already granted CREATE, ALTER, DROP, SELECT, MODIFY, AUTHORIZE on <keyspace syndeia_cloud_auth>
Warnings :
Role 'syndeia_admin' was already granted CREATE, ALTER, DROP, SELECT, MODIFY, AUTHORIZE on <keyspace syndeia_cloud_digital_threads>
Mon Sep 30 12:53:38 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Apache Kafka installed locally, starting Kafka if needed...
Mon Sep 30 12:53:38 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Confirming kafka port is up before proceeding...
Mon Sep 30 12:53:41 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Confirming janusgraph port is up before proceeding...
Mon Sep 30 12:53:41 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Install tmpfiles.d syndeia-cloud.conf file...
Mon Sep 30 12:53:41 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Install systemd syndeia-cloud .target and .service files...
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Reload systemd daemons...
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Check if sudoers/syndeia-cloud is installed...
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - sudoers file not installed, install from source
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - update sudoers file to be specific to logged in user (pj)
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - systemd services for SC 3.6 detected...
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Starting core Syndeia Cloud 3.6 services: sc-store sc-auth sc-graph sc-web-gateway...
Mon Sep 30 12:53:42 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Auth service port (56110) is up...
Mon Sep 30 12:53:48 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Store service port (56120) is up...
Mon Sep 30 12:53:49 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Graph service port (56180) is up...
Mon Sep 30 12:53:49 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Web-Gateway service port (9000) is up...
Mon Sep 30 12:53:49 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Enable SC services to start on boot...
Mon Sep 30 12:53:49 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Wait 30 seconds for system to stabilize...
Mon Sep 30 12:54:19 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Finish setup process (ie: create super.user, create sample data)...
Mon Sep 30 12:54:19 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: creating "super.user" account...
12:54:20.699 [info] com.intercax.syndeia.cli.core.DevopsConfig [] - root dir arg: None
12:54:20.709 [info] com.intercax.syndeia.cli.core.DevopsConfig [] - root dir config: Map()
12:54:20.910 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Lagom Syndeia client
12:54:20.910 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Action: superuser
12:54:20.911 [info] com.intercax.syndeia.cli.SyndeiaCli [] - User:
12:54:20.911 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Mode: Prod
12:54:21.302 [info] akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
12:54:21.885 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Creating StandaloneLagomClientFactory. Running mode found in devops config: Prod
12:54:21.886 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Creating StandaloneLagomClientFactory with ConfigurationServiceLocatorComponents.
12:54:21.899 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [graph :: "http://127.0.0.1:56180"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [store :: "http://127.0.0.1:56120"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [doors :: "http://127.0.0.1:56113"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [jama :: "http://127.0.0.1:56114"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [web-gateway :: "http://127.0.0.1:9000"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [kafka_native :: "http://localhost:9092"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [gitlab :: "http://127.0.0.1:56123"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [windchill :: "http://127.0.0.1:56170"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [auth :: "http://127.0.0.1:56110"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [bitbucket :: "http://127.0.0.1:56124"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [aras :: "http://127.0.0.1:56111"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [sysmlv2 :: "http://127.0.0.1:56118"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [teamworkcloud :: "http://127.0.0.1:56160"]
12:54:21.900 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration entry: [cas_native :: "http://localhost:9042"]
12:54:21.901 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Service locator configuration value for web-gateway: http://127.0.0.1:9000
12:54:21.925 [info] akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
12:54:33.537 [info] com.intercax.syndeia.superuser.SuperUserAction [] - Sign-up super user is successful
12:54:33.597 [info] akka.actor.CoordinatedShutdown [akkaAddress=akka://application, akkaUid=1917033255123195448, sourceThread=application-akka.actor.default-dispatcher-6, akkaSource=CoordinatedShutdown(akka://application), sourceActorSystem=application, akkaTimestamp=16:54:33.596UTC] - Running CoordinatedShutdown with reason [ClientStoppedReason]
12:54:33.636 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Action ran successfully (with a return code: 0).
Mon Sep 30 12:54:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Successfully ran DevOps (create) superuser action
Mon Sep 30 12:54:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: CHECK to see "super.user" account was (eventually) created...
Mon Sep 30 12:54:33 EDT 2024 [error] ./syndeia-cloud-3.6_install.bash, PID=549784: ~ DevOps (check) super.user signIn failed, waiting to try re-running DevOps (check) super.user signIn...
Mon Sep 30 12:54:39 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Successfully ran DevOps (check) super.user signIn
Mon Sep 30 12:54:39 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: creating default data set...
12:54:39.637 [info] com.intercax.syndeia.cli.core.DevopsConfig [] - root dir arg: None
12:54:39.646 [info] com.intercax.syndeia.cli.core.DevopsConfig [] - root dir config: Map()
12:54:39.831 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Lagom Syndeia client
12:54:39.831 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Action: setup
12:54:39.832 [info] com.intercax.syndeia.cli.SyndeiaCli [] - User: super.user
12:54:39.832 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Mode: Prod
12:54:40.093 [info] akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
12:54:40.492 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Creating StandaloneLagomClientFactory. Running mode found in devops config: Prod
12:54:40.493 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Creating StandaloneLagomClientFactory with ConfigurationServiceLocatorComponents.
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [graph :: "http://127.0.0.1:56180"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [store :: "http://127.0.0.1:56120"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [doors :: "http://127.0.0.1:56113"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [jama :: "http://127.0.0.1:56114"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [web-gateway :: "http://127.0.0.1:9000"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [kafka_native :: "http://localhost:9092"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [gitlab :: "http://127.0.0.1:56123"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [windchill :: "http://127.0.0.1:56170"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [auth :: "http://127.0.0.1:56110"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [bitbucket :: "http://127.0.0.1:56124"]
12:54:40.506 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [aras :: "http://127.0.0.1:56111"]
12:54:40.507 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [sysmlv2 :: "http://127.0.0.1:56118"]
12:54:40.507 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [teamworkcloud :: "http://127.0.0.1:56160"]
12:54:40.507 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration entry: [cas_native :: "http://localhost:9042"]
12:54:40.507 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Service locator configuration value for web-gateway: http://127.0.0.1:9000
12:54:40.521 [info] akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
12:54:41.777 [info] com.intercax.syndeia.api.AuthApi [] - Sign in to Syndeia Cloud for super.user successful.
12:54:57.349 [info] com.intercax.syndeia.api.RepositoryApi [] - Creating repositories... with RepositoryCreate(Some(InternalIdentityForm(None,None)),Some(ExternalIdentityForm(None,None)),None,None,None,None,Syndeia Repository,Some(Syndeia Internal Repository),Some(http://intercax.com:9000/repositories?isInternal=true),None,ReferenceCreate(Some(InternalReferenceForm(REPO-TYPE1)),None),None,None)
12:54:57.973 [info] com.intercax.syndeia.api.RepositoryApi [] - Creating repositories... with RepositoryCreate(None,Some(ExternalIdentityForm(Some(http://localhost.com/repositories/sysml),Some(http://localhost.com/repositories/sysml))),None,None,None,None,SysML Repository,Some(SysML Repository),Some(http://localhost.com/repositories/sysml),None,ReferenceCreate(Some(InternalReferenceForm(REPO-TYPE18)),None),None,None)
12:54:59.348 [info] com.intercax.syndeia.setup.RelationTypeSetUp [] - Found: 0 existing relation types
12:55:32.965 [info] com.intercax.syndeia.setup.CloudSetupAction [] - Set up action is successful
12:55:33.038 [info] akka.actor.CoordinatedShutdown [akkaAddress=akka://application, akkaUid=3979485647664124636, sourceThread=application-akka.actor.default-dispatcher-5, akkaSource=CoordinatedShutdown(akka://application), sourceActorSystem=application, akkaTimestamp=16:55:33.038UTC] - Running CoordinatedShutdown with reason [ClientStoppedReason]
12:55:33.071 [info] com.intercax.syndeia.cli.SyndeiaCli [] - Action ran successfully (with a return code: 0).
Mon Sep 30 12:55:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Successfully ran DevOps setup action
Mon Sep 30 12:55:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - systemd services for SC 3.6 detected...
Mon Sep 30 12:55:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Starting integration Syndeia Cloud 3.6 services: aras-impl artifactory-impl bitbucket-impl collaborator-impl confluence-impl digital-thread-impl doors-impl dscr-impl dse3-impl jama-impl jira-impl genesys-impl github-impl gitlab-impl restful-impl sysmlv2-impl teamcenter-impl teamworkcloud-impl testrail-impl volta-impl windchill-impl...
Mon Sep 30 12:55:33 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Aras service port (56111) is up...
Mon Sep 30 12:56:00 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Artifactory service port (56112) is up...
Mon Sep 30 12:56:00 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Bitbucket service port (56124) is up...
Mon Sep 30 12:56:00 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Collaborator service port (56126) is up...
Mon Sep 30 12:56:00 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Confluence service port (56140) is up...
Mon Sep 30 12:56:00 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Dt service port (56132) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Doors service port (56113) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Dscr service port (56131) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Dse3 service port (56128) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Jama service port (56114) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Jira service port (56130) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Genesys service port (56129) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Github service port (56150) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Gitlab service port (56123) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Restful service port (56127) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Sysmlv2 service port (56118) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Tc service port (56116) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Twcloud service port (56160) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Testrail service port (56117) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Volta service port (56125) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Syndeia Cloud: Waiting until SC Wc service port (56170) is up...
Mon Sep 30 12:56:01 EDT 2024 [info] ./syndeia-cloud-3.6_install.bash, PID=549784: - Done! |