Unified pipeline NG

Current situation or problem:

Now we have a bunch of various Jenkins jobs which create environments. All of the a copy-paste from one source with the same logic(for some moment in time). 

We need to create a single pipeline which is able to satisfy requirements for various environments - scratch, temporary, performance, karate, cypress.

In scope

Pipeline must provide next parameters:

• Target cluster
  • Predefined clusters
  • New
• Cluster based on 
  • Spot instances
  • On-demand instances
• Environment name
  • Predefined set 
  • Custom name
• Tenant names to create
  • List should be possible
  • Tenant admin name and password
  • List modules to activate
  • Load reference data
  • Load reference+sample data
  • FOLIO platform configuration
  • Deploy UI for specific tenant
• PostgreSQL database dump
  • empty
  • Predefined snapshots
• Resource, number of replicas, labels for affinity rules - helm configuration (how to work with that in rancher)
• Third-party components
  • self-managed
  • AWS provided
• UI modules versions
  • from platform-complete(specific branch stripes.json) 
  • UI selection (how to collect all available modules) (some of them could be skipped)
• Services versions
  • from database
  • from platform-complete(specific branch) 
  • UI selection (how to collect all available modules) (some of them could be skipped)
• Create new VPC or use existing

Pipeline must support new tenant creation for existing environment:

• Tenant names to create
  • List should be possible
  • List modules to activate
  • Load reference data
  • Load reference+sample data
  • FOLIO platform configuration
  • Deploy UI for specific tenant