Skip to content

Latest commit

 

History

History
1147 lines (1056 loc) · 46.9 KB

CHANGELOG.md

File metadata and controls

1147 lines (1056 loc) · 46.9 KB
Raw

Change Log

All notable changes to this project will be documented in this file.

Unreleased - as of Sprint 45 end 2016-08-22

Added

  • Automate
    • Enhanced messaging for provisioning: Displayed elements
      • ManageIQ Server name
      • Name of VM/Service being provisioned
      • Current Automate state machine step
      • Status message
      • Provision Task Message
      • Retry count (when applicable)
    • New method taggable? to programmatically determine if a Service Model class or instance is taggable.
    • Generic Objects: Model updates
      • Associations
      • Tagging
      • Service Methods: add_to_service / remove_from_service
    • Git Automate support
      • Branch/Tag support
      • Contents are locked and can be copied to other domains for editing
      • Editable properties
        • Enabled/Disabled
        • Priority
        • Removal of Domain
      • Dedicated Server Role to store the repository
  • Platform
    • PostgreSQL High Availability
      • Primary/Standby DB config in Appliance Console
      • Database-only appliance config in Appliance Console
      • Failover Monitor
    • Tenancy
      • Groundwork in preparation for supporting multiple entitlements
      • ApplicationHelper#role_allows and User#role_allows? combined and moved to RBAC
      • Post refresh hook to queue mapping of Cloud Tenants
    • Database maintenance scripts added to appliance
  • Providers
    • Containers: Models for container deployments
    • Google Compute Engine
      • Preemptible Instances
      • Retirement support
    • Hawkular
      • Alerts
        • Link miq alerts and hawkular events on the provider
        • Convert ManageIQ alerts/profiles to hawkular group triggers/members of group triggers
        • Sync the provider when ManageIQ alerts and alert profiles are created/updated
    • Added entities: Domains and Server Groups including their visualization in topology
    • Datasource entity now has deletion operation
    • Support more event types for datasource and deployment
    • Cross linking to VMs added to topology
    • Microsoft Azure: Added memory and disk utilization metrics
    • OpenStack
      • Host Aggregates
      • Region Support
    • Red Hat Enterprise Virtualization: Snapshot support
    • VMware vSphere: Storage profiles
  • REST API
    • Support for compressed ids in inbound requests
    • CRUD support for Arbitration Rules
  • Service Broker
    • Service Designer: Blueprint API is 90% done, edit and publish are still in development
    • Arbitration Profiles
      • Collection of pre-defined settings
      • Work in conjunction with the Arbitration Engine
    • Rules Engine: API completed
  • SmartState: Deployed new MiqDiskCache module for use with Microsoft Azure
    • Scan time reduced from >20 minutes to <5 minutes
    • Microsoft Azure backed read requests reduced from >7000 requests to <1000
  • User Interface
    • I18n support for UI plugins
    • Arbitration Profiles management for Service Broker
    • Re-check Authentication button added to Provider list views
    • Provisioning button added to the Templates & Images list and summary screens
    • Subtype option added to Generic Catalog Items
    • About modal added to OPS UI

Changed

  • Performance: Page rendering performance
    • Services -> Workloads -> All VMs page load time reduced from 93,770ms to 524ms (99%) with a test of 20,000 VMs
  • Platform
    • Upgrade ruby 2.2.5 to 2.3.1
    • Configure Rails web server - Puma or Thin
      • Puma is still the default
      • Planning on adding additional servers

Fixes

Notable fixes include:

  • Microsoft Azure: Fix proxy for template lookups
  • VMware vSphere: Block duplicate events
  • REST API
    • Hide internal Tenant Groups from /api/groups
    • Raise 403 Forbidden for deleting read-only groups
    • API Request logging

Unreleased - as of Sprint 44 end 2016-08-1

Added

  • Automate
    • Simulation: RBAC filtering applied to Object Attributes
    • Service Provisioning: Exposed number_of_vms when building the provision request for a service
    • Service Dialogs: Support for “visible” flag for dynamic fields
    • Expose Compliance and ComplianceDetail models
    • New associations on VmOrTemplate and Host models:
      • expose :compliances
      • expose :last_compliance
    • New Service Models
      • Compliance: expose :compliance_details
      • ComplianceDetail: expose :compliance, expose :miq_policy
    • Generic Object: Service models created for GenericObject and GenericObjectDefinition
  • Platform
    • PostgreSQL High Availability
      • Added repmgr to support automatic failover
      • Maintain list of active standby database servers
      • Added pg-dsn_parser for converting DSN to a hash
    • Tenancy: Added parent_id to CloudTenant as prerequisite for mapping OpenStack tenants to ManageIQ tenants
    • Watermark reports updated to be based on max of daily max value instead of max of average value
    • Nice values added to worker processes
  • Providers
  • Google Compute Engine: Metrics
  • Hawkular
    • Operations: Add Deployment, Start/stop deployment
    • Performance reports for datasources
    • Collect more metrics for datasource
  • Kubernetes: Cross-linking with OpenStack instances
  • Microsoft Azure: Support floating IPs during provisioning
  • Nuage: Inventory of Managed Cloud Subnets
  • Red Hat Enterprise Virtualization: v4 API
  • VMware vSphere: Storage Profiles modeling and inventory
  • VMware vCloud: Initial PRs for modeling and inventory
  • REST API
    • Support for arbitrary resource paths
    • Work started on ManageIQ API Client
    • Support for Arbitration Profiles
    • Support for Cloud Networks queries
    • Support for Arbitration Settings
    • Updated /api/users to support edits of user settings
  • User Interface
    • Both UIs updated to latest PatternFly and Angular PatternFly
    • Self Service UI language selections separated from Operations UI
    • Internationalization
      • Virtual Columns
      • Toolbars
      • Removed string interpolation (for better localization)
      • Changed to use gettext’s pluralization
    • Ansible Tower Jobs moved to the Configuration tab (from Clouds/Stacks)
    • Interactivity added to C3 charts on C&U screens

Changed

  • Automate
    • Simulation: Updated defaults
      • Entry-point: /System/Process/Request (Previous value of “Automation”)
      • Execute Method: Enabled
    • Infrastructure Provision: Updated memory values for VM provisioning dialogs to 1, 2, 4, 8, 12, 16, 32 GB
  • Performance: Reduced the time and memory required to schedule Capacity and Utilization data collection.
  • Platform: Expression refactoring and cleanup with relative dates and times
  • Providers: Hawkular
    • Upgrade of Hawkular gem to 2.3.0
    • Skip unreachable middleware providers when reporting
    • Add re-checking authentication status functionality/button
  • User Interface
    • Converted to TreeBuilder - Snapshot, Policy, Policy RSOP, C&U Build Datastores and Clusters/Hosts, Automate Results
    • CodeMirror version updated (used for text/yaml editors)

Removed

  • Platform
    • Removed rubyrep
    • Removed hourly checking of log growth and rotation if > 1gb
  • User Interface: Explorer Presenter RJS removal

Unreleased - as of Sprint 43 end 2016-07-11

Added

  • Automate
    • Service resolution based on Provision Order
    • Added /System/Process/MiqEvent instance
    • Added Provider refresh call to Amazon retire state machine in Pre-Retirement state
    • Service Dialogs: Added ‘Visible’ flag to all dialog fields
    • Class Schema allows for EMS, Host, Policy, Provision, Request, Server, Storage, and VM(or Template) datatypes
      • Value is id of the objects
      • If object is not found, the attribute is not defined.
    • Null Coalescing Operator
      • Multiple String values separated by “||”
      • Evaluated on new attribute data type “Null Coalescing”
      • Order dependent, left to right evaluation
      • First non-blank value is used
      • Skip and warn about missing objects
  • Platform: Custom attributes support in reporting and expressions
    • Selectable as a column
    • Usable in report filters and charts
  • Providers
    • Amazon: Public Images Filter
    • Networking
      • Separate Google Network Manager
      • NFV: VNFD Templates and VNF Stacks
    • Hawkular
      • Deployment entity operations: Undeploy, redeploy
      • Server operations: Reload, suspend, resume
      • Live metrics for datasources and transactions
      • Performance reports for middleware servers
      • Support for alert profiles and alert automated expressions for middleware server
      • Crosslink middleware servers with RHEV VMs
      • Collect and display deployment status
      • Datasources topology view
  • REST API
    • Support for report schedules
    • Support for approving or denying service requests
    • Support for OpenShift Container Deployments
    • Support for Virtual Templates
  • Service Broker
    • Started work on Service Broker to allow ManageIQ to select VM for you based on criteria (cloud, cost, or performance)
    • Added API backend for Resourceless Servers
    • Added datastore for the default settings for resourceless servers
  • SmartState: Generalized disk LRU caching module
    • Caching module can be used by any disk module, eliminating duplication.
    • Can be inserted “higher” in the IO path.
    • Configurable caching parameters (memory vs performance)
    • Will be employed to address Azure performance and throttling issues.
    • Other disk modules converted over time.
  • User Interface
    • Settings moved to top right navigation header
    • C3 Charts fully implemented - chart interaction coming soon!
    • Tagging for Ansible Tower job templates
    • Live Search added to bootstrap selects
    • Self Service UI Order History with detail

Changed

  • Automate: Generic Object: Model refactoring/cleanup, use PostgreSQL jsonb column
  • Performance
    • Capacity and Utlization improvements included reduced number of SQL queries and number of objects
    • Improved tag processing for Alert Profiles
    • UI Performance: specific pages targeted resulted in up to 98% reduction in rendering for those pages
  • Platform: PostgreSQL upgraded to 9.5 needed for HA feature
  • Providers:
    • Pluggability: Began extraction of Amazon Provider into separate repository
    • Hawkular
      • Upgraded to hawkular gem version 2.2.1
      • Refactor infrastructure for easier configuration
    • Ansible: Automate method updated to pass JobTemplate “Extra Variables” defined in the Provision Task
  • User Interface
    • Default Filters tree converted to TreeBuilder - more on the way
    • Cloud Key Pair form converted to AngularJS (Dana - UX team)
    • Toolbars:Cleaned up partials, YAML -> classes
    • Provider Forms: Credentials Validation improvements

Unreleased - as of Sprint 42 end 2016-06-20

Added

  • Providers
    • Ansible Tower
      • Collect Job parameters during Provider Refresh
      • Log Ansible Tower Job output when deployment fails
    • Containers: Limit number of concurrent SmartState Analyses
    • OpenStack
      • Cleanup of Nova services after scale down
      • Prevent retired instances from starting
    • Hawkular
      • Added missing fields in UI to improve user experience
      • Middleware as top level menu item
      • Default view for Middleware is datasource
  • Platform: Appliance Console
    • Limited menu when running inside a container
    • Removed menu items that are not applicable when running inside a container
  • Automate
    • Engine: Allow arguments in method calls during substitution
    • Policy: Built-in policy to prevent retired VM from starting on a resume power operation
    • Service Model: Expose provision_priority value
    • Retirement: Restored retirement logic to verify that VM was provisioned or contains Lifecycle tag before processing
    • Added lifecycle tag as a default tag

Changed

  • Providers: Pluggability
    • Ask, Don't Assume
      • Remove provider specific constants
      • Ask whether provider supports VM architecture instead of assuming support by provider type
  • Platform
    • Performance: Lazy load message catalogs for faster startup and reduced memory
    • Replication: Added "deprecated" in replication worker screen (Rubyrep replication will be removed in Euwe release)
    • Testing: Support for running tests in parallel
  • REST API
    • Documentation version is 2.2 for Darga
    • Updated /api entrypoint so collection list is sorted

Fixes

Notable fixes include:

  • Providers
    • Hawkular: Fixes for LiveMetrics
    • VMware: Fix for adding multiple disks

Unreleased - as of Sprint 41 end 2016-05-30

Changed

  • REST API: API CLI moved to tools/rest_api.rb
  • Providers: Hawkular
    • Test additions for topology
    • Optimization and enhancement of event fetching

[Removed](https://github.com/ManageIQ/manageiq/issues?q=milestone%3A%22Sprint+41+Ending+May+30%2C+2016%22+label%3A"technical debt")

  • REST API: gems/cfme_client removed

Unreleased - as of Sprint 40 end 2016-05-09

Added

  • REST API
    • Post Darga versioning updated to v2.3.0-pre
    • Added GET role identifiers

Changed

  • Platform
    • Tenancy: Splitting MiqGroup, Part 2
      • Filters moved to to Entitlement model
      • Enabler for sharing entitlements
    • MiqExpression Refactoring

Darga

Added

Automate

  • Ansible Tower added as Configuration Management Provider

    • Modeling for AnsibleTowerJob
    • Support for launching JobTemplates with a limit. (Target specific system)
    • Modeling for Provider, Configuration Manager, and Configured Systems
    • Provider connection logic
    • Support refresh of Configured Systems
    • wait_for_ip method added to state-machine
    • ansible_tower_client gem
      • Credential validation
      • Supported resources: Hosts, JobTemplates, Adhoc commands
    • Support for generating Service Dialogs from Ansible Tower JobTemplate
    • Support for setting Ansible Tower JobTemplate variables through dialog options and automate methods

  • Switchboard events for OpenStack

    • New Events: compute.instance.reboot.end, compute.instance.reset.end, compute.instance.snapshot.start
    • Policy Event updates: compute.instance.snapshot.end, compute.instance.suspend

  • Service Model

    • Added “networks” relationship to Hardware model
    • Support where method, find_by, and find_by!
    • Azure VM retirement modeling added
    • Storage: Added storage_clusters association
    • Openstack::NetworkManager::Network
      • cloud_subnets
      • network_routers
      • public_networks
    • Openstack Event compute.instance.power_on.end: added Policy event for vm_start

  • Services

    • Added instances/methods to generate emails for consolidated quota (Denied, Pending, Warning)
    • Enhanced Dialogs validation at build time to check tabs, and boxes in addition to fields.

  • Modeling changes

    • quota_source_type moved into instance
    • Added Auto-Approval/Email to VM Reconfigure
    • Default Retirement state-machine behavior changed to retain record (historical data)
    • Enhance state-machine fields to support methods

  • New model for Generic Object

  • New service model Account

  • SSUI: Support dialogs with dynamic fields

  • Simulate UI support for state machine retries

  • New script to rebuild provision requests

    • Reconstructs the parameters of an existing provision request so that request can be resubmitted through a REST API or Automate call.

Platform (Appliance)

  • Chargeback
    • Able to assign rates to tenants
    • Can generate reports by tenant
    • Currencies added to rates
    • Rate tiers
  • Authentication
    • Appliance Console External Auth updated to also work with 6.x IPA Servers
    • SAML Authentication (verified with KeyCloak 1.8)
    • External Authentication with IPA: Added support for top level domains needed in test environments
  • Configuration Revamp
    • Relies heavily on the config gem
    • New classes Settings and Vmdb::Settings
    • VMDB::Config is deprecated
    • config/*.tmpl.yml -> config/settings.yml
    • Locally override with config/settings.local.yml or config/settings/development.local.yml
  • Replication (pglogical)
    • Replacement of rubyrep with pglogical
    • New MiqPglogical class: provides generic functionality for remote and global regions
    • New PglogicalSubscription model: Provides global region functionality as an ActiveRecord model
    • Global and Remote regions instead of Master and subordinate
    • Replication enabled on remote regions
    • Remote regions subscribed to on Global Region
    • Replication Database Schema
      • Column order is important for pglogical
      • Regional and Global DBs MUST have identical schemas
      • Migrations must have timestamp later than the last migration of previous version for correct column order
      • Specs added to validate schema
      • See New Schema Specs for New Replication
    • Schema consistency checking - during configuration and before subscription is enabled
    • Tool to fix column order mismatches
  • Appliance Console
    • Ability to reset database
    • Ability to create region in external database
    • Added alias 'ap' as shortcut for appliance_console
    • Updates for external authentication settings
  • Shopping cart model for ordering services
  • Consumption_administrator role with chargeback/reporting duties
  • Expresions: refactor SQL for all operators now build with Arel

Providers

  • New provider types
    • Middleware
    • Networking
  • Amazon as a pluggable provider: almost completed
  • Containers
    • Reports
    • Linking registries with services
    • Bug fixes and UI updates
    • Network Trends, Heat Maps, Donuts
    • Chargeback
    • SmartState extended with OpenSCAP support
    • Policies
    • Cloud Cross Linking
    • Pod Network Metrics
    • Persistent Volume Claims
    • Seed for policies, policy sets, policy contents and conditions
    • Auto-tagging from kubernetes labels (backend only)
    • MiqAction to annotate container images as non-secure at
    • Multiple endpoint support OpenShift
  • Google Compute Engine
    • Inventory
    • Power Operations
    • Provisioning
    • Events
    • Better OS identification for VMs
    • Allow custom flavors
  • Hawkular
    • First Middleware provider
    • Inventory and topology
    • Event Catcher and power operations to reload and stop Middleware servers
    • Capacity and Utilization collected live on demand without need for Cap and U workers
    • Links to provider and entity in event popups on Timelines
      • Ability to configure default views
      • New Datasource entity (UI and Backend only)
  • Microsoft Azure
    • Http proxy support
    • Provisioning
    • Subscriptions and Events
    • Rely on resource location, metrics
  • Microsoft SCVMM
    • Inventory Performance improvements
    • Ability to delete VMs
  • VMware
    • Read-only datastores
    • Clustered datastores
    • Add/remove disk methods for reconfigure
  • Red Hat Enterprise Virtualization: Targeted refresh process
  • Red Hat OpenStack
    • Instance Evacuation
    • Better neutron modeling
    • Ceilometer events
    • cleanup SSL support
    • VM operations
    • Memory metrics
    • Image details
    • API over SSL
    • Integration feaures
      • Backend support for Live VM Migration
      • Backend support for VM resize
      • Support for Cinder and Glance v2
    • Enable / Disable cloud services
    • Make Keystone V3 Domain ID Configurable
    • File upload for SSH keypair
    • Add volumes during provisioning
    • Evacuating instances
  • Continued work on Multi-endpoint modeling
  • Generic Targeted refresh process

Provisioning

  • New providers able to be provisioned
    • Google Compute Engine
    • Microsoft Azure
  • Services Back End
    • Service Order (Cart) created for each Service Request based on current user and tenant.
  • VMware
    • Clustered Datastores in Provisioning
    • Distributed Switches referenced from database during provisioning workflow
  • Google Compute Engine: Added Google Auto-Placement methods

REST API

  • Enhanced filtering to use MiqExpression
  • Enhanced API to include Role identifiers for collections and augmented the authorization hash in the entrypoint to include that correlation
  • Added support for Service Reconfigure action
  • Added new service orders collection and CRUD operations
  • Actions for instances: stop, start, pause, suspend, shelve, reset, reboot guest
  • Actions provided to approve or deny provision requests
  • Ability to delete one’s own authenticated token
  • Added primary collection for Instances.
  • Added terminate action for instances.
  • Ability to filter string equality/inequality on virtual attributes.
  • For SSUI, ability to retrieve user’s default language and support for Dynamic Dialogs.
  • Support for Case insensitive sorting
  • Adding new VM actions
  • Authentication: Option to not extend a token’s TTL
  • CRUD for Tenant quotas
  • Support for /api/settings
  • Added support for Shopping Carts
  • Automation Requests approve and deny actions

SmartState

  • Microsoft SCVMM: new
    • Virtual hard disks residing on Hyper-V servers
    • VHD, and newer VHDX disk formats
    • Snapshotted disks
    • Same filesystems as other providers
    • Support for network-mounted HyperV virtual disks and performance improvements (HyperDisk caching)
  • Microsoft Azure: new
    • Azure-armrest: added offset/length blob read support.
    • Added AzureBlobDisk module for MiqDisk.
    • Implemented MiqAzureVm subclass of MiqVm.
  • Testing: Added TestEnvHelper class for gems/pending.
  • LVM thin volume support

Tenancy

  • Splitting MiqGroup
  • New model created for entitlements
  • Sharing entitlements across tenants will provide more flexibility for defining groups in LDAP
  • Added scoping strategy for provision request
  • Added ability to report on tenants and tenant quotas

User Interface

  • VM: Devices and Network Adapters
  • Cloud: Key Pairs, Object Stores, Objects, Object Summary
  • Bootstrap switches
  • C3 Charts (jqPlot replacement)
  • SSUI
    • RBAC Control of Menus and Features
    • Reconfiguring a Service
    • Set Ownership of a Service
    • I18n support added to the Self Service UI
    • Self Service UI group switcher
    • Support for Custom Buttons that use Dialogs
    • Navigation bar restyled to match Operations UI
    • HTML5 Console support for Service VMs (using new console-proxy implementation)
    • Shopping Cart
  • Add Ansible Tower providers
  • Containers
    • Persistent volumes, topology context menus
    • Dashboard network trends
    • Container environment variables table
    • Search functionality for Container topology
    • Dashboard no data cards
    • Refresh option in Configuration dropdown
    • Container Builds tab, Chargeback
  • I18n
    • Marked translated strings directly in UI
    • Gettext support
    • I18n for toolbars
  • Topology Status Colors
  • Vertical navigation menus
  • VM Reconfigure - add/remove disks
  • Orderable Orchestration Templates - create and copy
  • Explorer for Datastore Clusters for VMware vSphere 5+
  • Template/Image compliance policy checking (previously only allowed for VMs/Instances)
  • New UI for replication configuration
  • OpenStack - Cloud Volumes Add/Delete/Update/Attach/Detach
  • Ansible Inventories/Configured Systems
  • Support for Ansible Tower Jobs
  • Support to add Service Dialog for a Job Template & display Surveys on summary screen
  • Support added for Evacuate Openstack VMs

Removed

  • Providers: Removed Amazon SDK v1

Notable Fixes and Changes

  • Tag management cleanup
    • Tags are removed from managed filters for all groups after deletion
    • Update of managed filters after tag rename (in progress)
  • SmartState Analysis
    • LVM thin volume - fatal error: No longer fatal, but not supported. Thin volume support planned.
    • LVM logical volume names containing “-”: LV name to device file mapping now properly accounts for “-”
    • EXT4 - 64bit group descriptor: Variable group descriptor size correctly determined.
    • Collect services that are symlinked
  • Automate
    • Retirement state-machine updates for SCVMM
    • Enhanced .missing method support
      • Save original method name in _missing_instance property
      • Accessible during instance resolution and within methods
  • Self Service UI extracted into its own repository setting up pattern for other independent UIs
    • Initializers can now load ApplicationController w/o querying DB
    • 10-20% performance improvement in vm explorer
  • User Interface
    • Converted toolbar images to font icons
    • Enabled font icon support in list views
    • Implemented Bootstrap switch to replace checkboxes
    • SVG replacement of PNGs
    • SlickGrid replaced with Patternfly TreeGrid
    • Patternfly style updates to the Dashboard and other areas
    • Updates to support multiple provider endpoints
    • Moved Services to top level Menus
  • Logo image on top left links to user's start page
  • VM Provisoning: Disabled Auto-Placement logic for create_provision_request and Rest API calls
  • Performance
    • Support for sorting Virtual Columns in the database
    • Service Tree improvement
    • RBAC: Ongoing effort to reduce the number SQL queries and quantity of data being transferred
    • Metrics Rollups bug fix
    • Performance capture failure on cloud platforms caused by orphan VMs
    • Reduction in base size of workers
    • Reduction in memory used by EmsRefresh
  • Platform
    • Updated to Rails 5 (using Rails master branch until stable branch is cut)
    • Appliance OS updated to CentOS 7.2 build 1511
    • oVirt-metrics gem fixed for Rails 5
    • Log Collection behavior updated
      • Zone depot used if requested on zone and defined. Else, collection disabled
      • Appliance depot used if requested on appliance and defined. Else, collection disabled
    • DB seeding no longer silently catches exceptions
    • Workers forked from main server process instead of spawned
    • Updated to newer ansible_tower_client gem
      • Accessors for Host#groups and #inventory_id
      • Allow passing extra_vars to Job Template launch
      • Added JSON validation for extra_vars
  • Providers
    • Memory issues during inventory collection
    • Validating endpoints should not save data

Capablanca Release

Added Features

Providers

  • Kubernetes
    • RHEV Integration
    • Events
    • Topology Widget
    • VMware integration
    • Inventory: Replicators, Routes, Projects
    • SmartState Analysis
  • Containers
    • Resource Quotas
    • Component Status
    • Introduction of Atomic
  • Namespacing
  • Preparation for pluggable providers
  • OpenStack, Containers
  • Amazon: Added M4 and t2.large instance types
  • OpenStack
    • Improved naming for AMQP binding queues
    • Shelve VMs
    • Neutron Networking
  • Foreman: Exposed additional properties to reporting
  • Azure
    • Initial work for Inventory Collection, OAuth2, azure-armrest gem
    • Azure Provider models
    • Power Operations
  • RHEVM: Reconfigure of Memory and CPU
  • Orchestration: Reconfiguration
  • Reporting on Providers
    • Ability to report on Performance
    • Host Socket and Total VMs metrics
    • Watermark reports available out-of-the-box
  • Google Compute Engine
    • New Provider
    • Ability to validate authentication

Provisioning

  • Filter Service Catalog Items during deployment
  • OpenStack Shared Networks
    • Identified during inventory refresh
    • Available in the Cloud Network drop-down in Provisioning across all OpenStack Tenants
  • Enabled SCVMM Auto placement
  • Provision Dialogs: field validation for non-required fields
  • Service Dialogs: Auto-refresh for dynamic dialog fields
  • Foreman: Filtering of available Configuration Profiles based on selected Configured Systems in provisioning dialog

User Interface

  • Charting by field values
  • Cloud Provider editor
    • Converted to Angular
    • Uses RESTful routes
  • Orchestration: Stacks Retirement added
  • Retirement screens converted to Angular
  • DHTMLX menus replaced with Bootstrap/Patternfly menus
  • Host editor converted to Angular
  • Added donut charts
  • Tenancy Roles for RBAC
  • Self Service UI is enabled and included in build
  • Updated file upload screens

Event Switchboard

  • Initiate event processing through Automate
  • Users can add automate handlers to customize event processing
  • Centralized event mappings
  • Moves provider event mappings from appliance file (config/event_handling.tmpl.yml) into the automate model
  • Organization of Events through automate namespaces
  • Event handling changes without appliance restarts
  • Notes:
    • New events must be added to automate model
    • Built-in event handlers added for performance
    • Requires update of the ManageIQ automate domain

Tenancy

  • Model
    • new Tenant model associations
    • Automate domains
    • Service Catalogs
    • Catalog Items
    • Assign default groups to tenants
    • Assign groups to all VMs and Services
    • Assign existing records to root tenant Provider, Automate Domain, Group, TenantQuota, Vm
    • Expose VM/Templates association on Tenant model
  • New Automate Service Models
    • Tenant
    • TenantQuota
  • UI
    • RBAC and Roles - Access Roles features exposed
    • New roles created for RBAC
    • Quota Management
  • Associate Tenant to Requests and Services
  • Update of VM tenant when owning group changes
  • Tagging support
  • Automate Tenant Quotas
    • Customizable Automate State Machine for validating quotas for Service, Infrastructure, and Cloud
    • Default Setting based on Tenant Quota Model
    • Can be enforced per tenant and subtenants in the UI
    • Selection of multiple constraints (cpu, memory, storage)
    • Limits are enforced during provisioning

Control

  • New Events available for use with Policy
    • Host Start Request
    • Host Stop Request
    • Host Shutdown Request
    • Host Reset Request
    • Host Reboot Request
    • Host Standby Request
    • Host Maintenance Enter Request
    • Host Maintenance Exit Request
    • Host Vmotion Enable Request
    • Host Vmotion Disable Request

REST API

  • Querying Service Template images
  • Querying Resource Actions as a formal sub-collection of service_templates
  • Querying Service Dialogs
  • Querying Provision Dialogs
  • Ability to import reports
  • Roles CRUD
  • Product features collection
  • Chargeback Rates CRUD
  • Reports run action
  • Report results collection
  • Access to image_hrefs for Services and Service Templates
  • Support for custom action buttons and dialogs
  • Categories and tags CRUD
  • Support password updates
  • Enhancements for Self-Service UI
  • Enhancements for Tenancy

Automate

  • Automate Server Role enabled by default
  • Configurable Automate Worker added
  • State Machine
    • Multiple state machine support
    • Allow for a state to be skipped (on_entry)
    • Allow for continuation of a state machine in case of errors (on_error)
    • Allow methods to set the next state to execute
    • Added support for state machine restart
  • Identify Visible/Editable/Enabled Automate domains for tenants
  • Set automate domain priority (scoped per tenant)
  • Service model updates
  • Import/export updates to honor tenant domains

SmartState

  • Support for VMware VDDK version 6
  • Storage: Added FCP, iSCSI, GlusterFS

Security

  • Authentication
    • External Auth to AD web ui login & SSO - Manual configuration
    • External Auth to LDAP - Manual configuration
  • Supporting Additional External Authentications
    • Appliance tested with 2-Factor Authentication with FreeIPA >= 4.1.0

Appliance

  • PostgreSQL 9.4.1
  • CentOS 7.1
  • Apache 2.4
  • jQuery 1.9.1
  • STIG compliant file systems
  • Changed file system from ext4 to xfs
  • Added support for systemctl
  • Support for running on Puma, but default is Thin
  • Reworked report serialization for Rails 4.2
  • Replication: Added Diagnostics
  • Appliance Console
  • Standard login: type root (not admin)
  • Standard bash: type appliance_console
  • GitHub Repository
  • vmdb rerooted to look like a Rails app
  • lib moved into gems/pending
  • Build and system directories extracted to new repositories
  • Extracted C code to external gems
  • MiqLargeFileLinux => large_file_linux gem
  • MiqBlockDevOps => linux_block_device and memory_buffer gems
  • MiqMemory => memory_buffer gem
  • SlpLib => slp gem
  • Gem updates
    • Upgraded rufus scheduler to version 3
    • Upgraded to latest net-sftp
    • Upgraded to latest net-ssh
    • Upgraded to latest ruby-progressbar
    • Upgraded to latest snmp
    • LinuxAdmin updated to 0.11.1

Removed

  • Core: SOAP server side has been removed

Notable Fixes and Changes

  • RHEVM SmartState Analysis issues.
    • Fix for RHEV 3.5 - ovf file no longer on NFS share.
    • Fix for NFS permission problem - uid changed when opening files on share.
    • Fix for environments with both, NFS and LUN based storage.
    • Timeout honored.
  • SmartState Refactoring
    • Refactored the middle layer of the SmartState Analysis stack.
    • Common code no longer based on VmOrTemplate models.
    • Facilitate the implementation of SmartState for things that are not like VMs.
    • Enabler for Container SmartState
  • Appliance: Cloud-init reported issues have been addressed.
  • Automate: VMware snapshot from automate fixed - memory parameter added
  • REST API Source refactoring: app/helpers/api_helper/ → app/controllers/api_controller
  • Replication: Added heartbeating to child worker process for resiliency
  • Providers
  • Moved provider event filters into the database (blacklisted events)
  • SCVMM Inventory Performance Improvement
  • Fixed caching for OpenStack Event Monitors
  • OpenStack
    • Generic Pagination
    • Better Neutron support
    • Deleting unused RabbitMIQ queues
  • Provisioning: Fixed unique names for provisioned VMs when ordered through a service
  • UI
    • Technical Debt Progress
      • Remaining TreePresenter/ExplorerPresenter conversions in progress
      • Switched from Patternfly LESS to SASS
      • Replaced DHTMLXCombo controls
      • Replaced DHTMLXCalendar controls
    • Patternfly styling
    • Schedule Editor updated to use Angular and RESTful routes
    • Increased chart responsiveness
    • Fixes for Japanese I18n support
    • Fixed alignment of Foreman explorer RBAC features with the UI
  • Chargeback: selectable units for Chargeback Rates

Botvinnik Release

Added Features

Providers

  • General
    • Added refresh status and errors, viewable on Provider Summary Page.
    • Added collection of raw power state and exposed to reporting.
    • Orchestration: Support for Retirement
    • Update authentication status when clicking validate for existing Providers.
    • Hosts and Providers now default to use the hostname column for communication instead of IP address.
  • SCVMM
    • Provisioning from template, Kerberos Authentication
    • Virtual DVD drives for templates
  • Kubernetes
    • UI updates including Refresh button
    • Inventory Collection
    • EMS Refresh scheduling
  • Foreman
    • Provider refresh
    • Enabled Reporting / Tagging
    • Exposed Foreman models as Automate service models
    • Zone enablement
    • EMS Refresh scheduling
    • Added tag processing during provisioning.
    • Added inventory collection of direct and inherited host/host-group settings.
    • Organization and location inventory
  • Cloud Providers
  • Cloud Images and Instances: Added root device type to summary screens.
  • Cloud Flavors: Added block storage restriction to summary screens.
  • Enabled Reporting.
  • OpenStack
    • Inventory for Heat Stacks (Cloud and Infrastructure)
    • Connect Cloud provider to Infrastructure provider
    • OpenStack Infrastructure Host Events
    • Autoscale compute nodes via Automate
    • Support for non-admin users to EMS Refresh
    • Tenant relationships added to summary screens
    • OpenStack Infrastructure Event processing
    • Handling of power states: paused, rebooting, waiting to launch
    • UI OpenStack Terminology: Clusters vs Deployment Roles, Hosts vs Nodes
  • Amazon
    • AWS Region EU Frankfurt
    • Inventory collection for AWS CloudFormation
    • Parsing of parameters from orchestration templates
    • Amazon Events via AWS Config service
    • Event-based policies for AWS
    • Added a backend attribute to identify public images.
    • Added C4, D2, and G2 instance types.
    • Virtualization type collected during EMS refresh for better filtering of available types during provisioning.
    • Handling of power states
  • Orchestration
  • Orchestration Stacks include tagging
  • Cloud Stacks: Summary and list views.
  • Orchestration templates
    • Create, edit, delete, tagging, 'draft' support
    • Create Service Dialog from template contents
  • Enabled Reporting / Tagging.
  • Improved rollback error message in UI.
  • Collect Stack Resource name and status reason message.

Provisioning

  • Heat Orchestration provisioning through services
  • Foreman
    • Provisioning of bare metal systems
    • Uses latest Foreman Apipie gem
  • Allow removing keys from :clone_options by setting value to nil
  • OpenStack: Added tenant filtering on security groups, floating IPs, and networks.
  • Amazon: Filter of flavors based on root device type and block storage restrictions.

User Interface

  • Bootstrap/Patternfly
    • Updates to form buttons with Patternfly
    • Login screen converted to Bootstrap / Patternfly
    • Header, navigation, and outer layouts converted to Bootstrap / Patternfly
    • Advanced search converted to Bootstrap / Patternfly
  • AngularJS
    • Repository Editor using AngularJS
    • Schedule editor converted to AngularJS
  • I18N
    • HAML and I18n strings 100% completed in views
    • Multi-character set language support
    • Can now set the locale for both server and user
  • HTML5 Console for RHEVM, VMware, and OpenStack
  • Menu plugins for external sites
  • Charting updates: jqPlot, default charts, chart styling, donut chart support
  • UI Customizations with Less
  • Dashboard tabs updated
  • Replaced many legacy Prototype calls with jQuery equivalents
  • Tagging support and toolbars on list views

REST API

  • Total parity with SOAP API. SOAP API is now deprecated and will be removed in an upcoming release.
  • Foundational
    • Virtual attribute support
    • Id/Href separation- Enhancement to /api/providers to support new provider class
  • Providers CRUD
  • Refresh via /api/providers
  • Tag Collection /api/tags
  • Tag Management (assign and unassign to/from resources)
  • Policy Management: Query policy and policy profiles conditions
  • VM Management
    • Custom Attributes
    • Add LifeCycle Events
    • Start, stop, suspend, delete.
  • Accounts sub-collection /api/vms/#/accounts
  • Software sub-collection /api/vms/#/software
  • Support for external authentication (httpd) against an IPA server.

Automate

  • Enhanced UI import to allow granularity down to the namespace.
  • Cloud Objects exposed to Automate.
  • Allow Automate methods to override or extend parameters passed to provider by updating the clone_options during provisioning.
  • New service model for CloudResourceQuota.
  • Exposed relationships through EmsCloud and CloudTenant models.
  • Exposed cloud relationships in automate service models.
  • Persist state data through automate state machine retries.
  • Moved auto-placement into an Automate state-machine step for Cloud and Infrastructure provisioning.
  • Added common "Finished" step to all Automate state machine classes.
  • Added eligible_* and set_* methods for cloud resources to provision task service model.
  • Ability to specify zone for web service automation request
  • Ability to override request message
  • Updated provisioning/retirement entry point in a catalog item or bundle.
  • Disabled domains now clearly marked in UI.
  • Automate entry point selection reduced to state machine classes.
  • Retirement
    • New workflow
    • Detection of User vs. System initiated retirement

Fleecing

  • Qcow3
  • VSAN (VMware)
  • OpenStack instances
  • Systemd fleecing support
  • XFS filesystem support

I18n

  • All strings in the views have been converted to use gettext (I18n) calls
  • Can add/update I18n files with translations

Service Dialogs

  • Dynamic field support: text boxes, text area boxes, checkboxes, radio buttons, date/time control
  • Dynamic list field refactored into standard drop-down field
  • Read only field support
  • Dialog seeding for imports
  • Service provisioning request overrides

IPv6

  • Allow IPv6 literals in VMware communication by upgrading httpclient
  • Allow IPv6 literals in RHEVM/ovirt communication by fixing and upgrading rest-client and ruby 2.0
  • Fixed URI building within ManageIQ to wrap/unwrap IPv6 literals as needed

Security

  • Lock down POODLE attacks.
  • Support SSL for OpenStack
    • Deals with different ways to configure SSL for OpenStack
      • SSL termination at OpenStack services
      • SSL termination at proxy
      • Doesn't always change the service ports
    • Attempts non-SSL first, then fails over to SSL
  • Kerberos ticket based SSO to web UI login.
  • Fix_auth command tool can now update passwords in database.yml
  • Better messaging around overwriting database encryption keys
  • Make memcached listen on loopback address, not all addresses
  • Migrate empty memcache_server_opts to bind on localhost by default

Appliance

  • Rake task to allow a user to replicate all pending backlog before upgrading.
  • Appliance Console: Added ability to copy keys across appliances.
  • Ruby 2.0
    • Appliance now built using Ruby 2.0
    • New commits and pull requests - tested with Ruby 2.0
  • Ability to configure a temp disk for OpenStack fleecing added to the appliance console.
  • Generation of encryption keys added to the appliance console and CLI.
  • Generation of PostgreSQL certificates, leveraging IPA, added to the appliance console CLI.
  • Support for Certmonger/IPA to the appliance certificate authority.
  • Iptables configured via kickstart
  • Replaced authentication_(valid|invalid)? with (has|missing)_credentials?
  • Stop/start apache if user_interface and web_services are inactive/active
  • Rails
    • Moved to Rails 4 finders.
    • Removed patches against the logger classes.
    • Removed assumptions that associations are eagerly loaded.
    • Updated preloader patches against Rails
    • Updated virtual column / reflection code to integrate with Rails
    • Started moving ActiveRecord 2.3 hash based finders to Relation based finders
    • Backports and refactorings on master for Rails 4 support
    • Rails server listen on loopback when running appliance in production mode
    • Bigint id columns
    • Memoist gem replaced deprecated ActiveSupport::Memoizable
  • Upgraded AWS SDK gem
  • Upgraded Fog gem
  • LDAP
    • Allow undefined users to log in when “Get User Groups from LDAP” is disabled
    • Ability to set default group for LDAP Authentication
  • Allow Default Zone description to be changed
  • Lazy require the less-rails gem

Removed

  • SmartProxy:
    • Removed from UI
    • Directory removed
  • IP Address Form Field: Removed from UI (use Hostname)
  • Prototype from UI
  • Support for repository refreshes, since they are not used.
  • Support for Host-only refreshes. Instead, an ESX/ESXi server should be added as a Provider.
  • Rails Fork removal
    • Backport disable_ddl_transaction! from Rails master to our fork
    • Update the main app to use disable_ddl_transaction!
    • Add bigserial support for primary keys to Rails (including table creation and FK column creation)
    • Backport bigserial API to our fork
    • Update application to use new API
  • Old C-Language VixDiskLib binding code
  • Reduced need for Rails fork.
  • Testing: Removed have_same_elements custom matcher in favor of built-in match_array
  • Graphical summary screens
  • VDI support
  • Various monkey patches to prepare for Ruby 2 and Rails 4 upgrades

Notable Fixes and Changes

  • Provisioning
    • Fixed duplicate VM name generation issue during provisioning.
    • Provisioning fix for non-admin OpenStack tenants.
    • Provisioning fix to deal with multiple security groups with the same name.
  • Automate
    • Prevent deletion of locked domains.
    • Corrected ManageIQ/Infrastructure/vm/retirement method retry criteria.
    • Fixed timeout issue with remove_from_disk method on a VM in Automate.
  • Providers
  • server_monitor_poll default setting changed to 5 seconds, resulting in shorter queue times.
  • Fixed issue where deleting an EMS and adding it back would cause refresh failure.
  • EventEx is now disabled by default to help prevent event storms
  • Fixed "High CPU usage" due to continually restarting workers when a provider is unreachable or password is invalid.
  • RHEVM/oVirt:
    • Ignore user login failed events to prevent event flooding.
    • Discovery fixed to eliminate false positives
  • SCVMM: Fixed refresh when Virtual DVD drives are not present.
  • OpenStack - Image pagination issue where all of the images would not be collected. - OpenStack provider will gracefully handle 404 errors. - Fixed issue where a stopped or paused OpenStack instance could not be restarted.
  • Database
    • Fixed seeding of VmdbDatabase timing out with millions of vmdb_metrics rows
    • Database.yml is no longer created after database is configured.
    • Fixed virtual column inheritance creating duplicate entries.
  • Appliance
    • Fixed ftp log collection regression
    • Ruby 2.0
      • Ruby2 trap logging and worker row status
    • Fixed appliance logrotate not actually rotating the logs.
    • Gem upgrades for bugs/enhancements
      • haml
      • net-ldap
      • net-ping
  • Other
  • Workaround for broker hang: Reported as VMware events and capacity and utilization works for a while, then stops.
  • Chargeback
  • Storage C&U collected every 60 minutes.
  • Don't collect cpus/memory available unless you have usage.
  • Clean up of CPU details in UI
  • SMTP domain length updated to match SMTP host length
  • Fleecing: Fixed handling of nil directory entries and empty files
  • Fixed issue where deleting a cluster or host tries to delete all policy_events, thus never completing when there are millions of events.
  • Fixed inheriting tags from resource pool.
  • UI: Fixed RBAC / Feature bugs