Internal Release Notes – Q2 : 24.26.0 OpenTV Video Platform - DRAFT version

Release summary 

This release…  

[SHB] - Disney+ (D+) "isOriginals" metadata deprecation

Product

This feature is to update the D+ ingest module for the use of the new metadata attribute regional "Original" and deprecation of the global "isOriginal" attribute in the Disney Streaming MMFS feed.

Inclusion of new D+ metadata fields Brands, subBrands, Production Country and Original Language.

OpCon Channel Logo (Shared OPF/Umbrella/HOT

Product

All Operators when using OpCon, operators will be able to manage channel images directly from the OpCon  channel management screens, this includes

• Uploading new images

• Deleting existing images

• setting preferred images 

Ingress re-architecture

Internal

The purpose of the feature is to rearchitect the ingress solution of the OPF3 platform, to be able to remove the "SNI-ROUTER" EC2s and the "SERVICE-ADVERTISER" ad-hoc solution.

This will enable the possibility to have autoscaling in the Ingress of the OPF solution (out of scope in this Q2 feature), as well as, minimizing the potential problems when autoscaling the rest of the applications and the eks cluster.  

[4iG] [PERF] Characterization Test of operator API GET /adm/device/{uid}

Internal

This is a characterization test for the maximum throughput of the /adm/devices/{uid} API requiring keycloak authentication

[SLA] OPF3's MongoDB community replacement by MongoDB Atlas

Internal

OPF3 product is composed of several modules/services, out of which at least 15 services are using MongoDB. Today's deployment architecture is to have one MongoDB cluster serving the 15 services. Using MongoDB Atlas as a replacement of MongoDB community. This will reduce the overall MongoDB cost by capitalizing on only few shared clusters for R&D and SIT Lab and also segregate critical OPF3 services : ADM, RMG, User Recordings, MDS, Common cluster with Atlas.

[4iG] Parental Ratings - Series / Season

Product

Feature to implement Parental Ratings in Series/Season

User Recordings - Parental Ratings

Product

Feature to implement the gap identified in OPF-6373 (Rating object not visible on CDVR APIs

[4iG] User Recordings - Locale & Device Filter Enhancements

Product

Feature to optimise the response size of the User Recordings APIs by allowing clients to filter by locale and device

OPF AutoScaling finalization, Pods resizing

Internal

Feature to execute the Auto Scaling use cases and enabled for Front End Modules : ADM, Content Builder, CDF, CDG Recommendations, CRM GW post account, CRM GW post Entitlements, IAS, MDS, Recommendations Facade, RMG, Search Facade, UAV, URL Builder, User Recordings, Auth Facade

Enhance RMS metadata coverage

Product

There are some gaps noted during migration of existing npvr recordings (Velocix cVRM) to OPF User Recording in terms of metadata coverage.

 This requires changes to RMG to support additional fields, and on deployment has a pre-requisite that 4iG keep at least 90 days of metadata available online to allow retrieval of existing metadata into new OPF user recordings.

[Security] [BCP DRP] E2E readiness: restore environment (simple customer customizations) + nanoSAT (Phase 1.3)

Internal

Phase  1.3:  based on the results of phase1, reviewed RTO based on the feedback and lessons from phase 1

1.3.1 : Improve procedures to update according to new RTO

1.3.2 : Update BCP/DRP standards and RPO/RTO metrics

[OPF][Security][RR] Fix LUA undocumented services (back doors) having weak (or no) security

Internal

There several LUA scripts have been identified to expose services without any security or with weak security

In this feature the back doors have been identified and removed from the LUA scripts if not strictly necessary. Specific API present in LUA files possess proper security controls and authentication and are properly documented.

CMS4 Purge Job Migration

Internal

When migrating content from CMS3 to OPF3 the purge jobs aren't getting migration. A procedure is required to migrate these.

In order the perform the migration : Export SQL from CMS4, Script to iterate that and create jobs via CWM API, Update related CPM content with profile/purge job data.

In this feature the Purge jobs are recreated on OPF3 and migrated content can be purged.

Upgrade Zookeeper to 3.8.3

Internal

Zookeeper 3.4.13  is  NOT compatible with Java17 supported zookeeper Client Version.

In this feature, automated playbook/Jenkins Job for upgrade to Zookeeper 3.8.3.

[Independent Services] Split of the Infra stack - AuthZ Service independent deployment

Internal

As of today, OPF product is deployed as monolithic release that is cut on quarterly basis. All OPF services are bundled and delivered together in an OPF release. This approach prevents the fast delivery of Business features and it brakes the DevOps approach.

This feature is an independent deployment stack ready to be handed-over to the AuthZ DevOps team with OPF Terraform stack, Ansible playbook, Infra-as-code gitlab repository, deployment pipeline, … for the AuthZ business service

[Cost reduction] B/G Single VPC deployment

Internal

Today OPF3 AWS Infrastructure is architected around a multi-VPC design with 4 main VPCs , Admin, Data, Blue and Green, and the B/G update strategy is implemented at VPC level. This multi-VPC networking design implies a large cost when taken at scale.

This feature is to re-design the infrastructure architecture to deploy all OPF instnace resources in a unique VPC and centralize the connectivity with the corporate network though a reduced number of Bastion VPCs in a Deployment account. The goal is to reduce the cost of OPF in AWS.

Purge of redundant data(productLinks/contents) at MDS

Internal

Multiple tests with scope ON/OFF were done using CLC/TC data. Based on the analysis of results, identified a need for purge/deletion of the redundant data(productLinks & editorial/technical contents if any) at MDS.  In this feature, the purge is based on cron, configurable, similar to programs/events purge. 

[KS Monitoring] DVM EC2 deployed on top of Golden AMI

Internal

Some VPCs are still not using the Golden Image. Therefore those hosts are not hardened and also not monitored due to the fact that the Crowdstrike agent is not installed that decrease the security of the system.

This feature is to automate DVM EC2 deployment (with DVM-Jenkins docker image + scripts to be mounted in the image).

Watch Party (aka GES)

Starhub

Allows a subscriber to invite a number of guests to a watch party, where channel entitlements are temporarily provided to guests (non-subscribed customers) to watch specific events.

RabbitMQ Services Standardization

Internal

The use of events, notifications, publishers and consumers makes up a core part of the OPF platform, key functionality fails when the Rabbit infrastructure is not maintained or configured correctly and in situations where messages are lost or fail to process, we see issues downstream across the platform and reporting. 

This feature is to introduce a standard approach to make the usage more consistent by

• Introducing standards for message headers

• Introducing a standard minimum approach to dealing with producer errors and retries

• Introducing a standard minimum approach to dealing with consumer errors and retries 

• Introducing a standard approach to the use of DLQ's ; no value in filling up a queue with no way to re-run the message. 

• Documentation to be produced for every consumer to detail the message using a standard tooling

[SLA] CWM Job / Status Persistence

Internal

There were issues with the persistence of the workflow job statuses, because of which many of the workflow jobs  which were stuck/inProgress and never picked up once the CWM comes back.  This feature is to resolve this issue.

[SHB] - Cessation of Channels - Removal of LTCU asset from encoder (tech debt)

Internal

This feature is Removal of Content (captured asset) for LTCU recordings when all Technical channels, channel events, LTCU and STCU are removed as part of an Editorial Channel deletion (purge). When an Editorial Channel is removed, associated assets on capture device (recorder) will be removed.

[Common UI] Channels & Products completion

Product

opui-channels and opui-products is a common user interface developed to manage OPF and SSP channels and products related operations.

[UIC] [OpCon] RAILS Filter on Target Device Type

Internal

This feature is to Reduce the number of templates to create, manage and improve the RAILS operational efficiencies.

The solution is to add a target device filter onto the Rail and Rail Section. This would allow the operator to create far fewer templates and only have to configure a limited number of RAILS that are filtered on each template.

[ION][ContentBuilder]: An API for /templateviews/hierarchy by ID

Internal

Requirement from ION is that there is a need for the following API 

GET  /templateviews/hierarchy/{templateIdOrName} and it should return the referenced templateview & its children, no rails only the structure is required. 

[4iG][Entel] Granular control of session management

Product

This feature is to manage session concurrency based on classification of devices, in addition to the current support which is only at the account level, or restricted to unmanaged devices. OPF provides support for limiting the number of concurrent sessions that can be streamed from an account.

The purpose of this feature is to extend such support so that groupings of devices can have bespoke limits, specifically for the following categories of devices:

• Big Screen (TVs, STBs, TV Key Devices etc.)

• Trusted Open Devices – E.g. WV level 1

• Untrusted Open Devices – E.g. WV level 3

• Fully managed devices

[4iG] Auto Assign deviceClass to device

Product

Providing the capability to automatically assign a class to a device, based on entities provided at device creation time. This is to then enable more granular management of such classes of devices, such as being able to restrict number of active devices based on their class.

[4iG] Messaging HE integration - SmartTVs with Tizen and WebOS

Product

This feature introduces support in Nagra OPF for AWS IOT Core for Client messaging.  This is being provided as some devices, particularly SmartTVs based on Tizen and WebOS, cannot use the existing Firebase integration for message delivery. Use of AWS IOT Core will provide a mechanism for such devices while leaving existing Firebase supported devices as-is.

[4iG] Automatic device rotation - Q2

Product

Operators typically want to limit the maximum number of devices each account can self provision against their account.  Nominally, when the limit has been reached, the user will be unable to register a further device and will be met with an error.

 This feature gives the operator the ability to enable a device to be added, even if the limit has reached, by firstly automatically removing an existing device.

[ENTEL] Entel Geo-Targeting On/offnet Filtering - Q2

Product

The requirement is to filter by account profile to allow both country and OTT/FTTH filtering and On / Off-Net filtering. 

[ENTEL] In Home Detection - Q2

Product

When a device (STB or SmartTV) is connected via ENTEL FTTH, ENTEL wants to ensure that the device is only connected to the "home" address of the subscriber to which the device is provisioned by tracking the MAC address of the FTTH CPE device against the account. And using this information to restrict access to the service if the device attempts to access the service with a different CPE MAC address than the one provisioned to it.

[ENTEL] Entel Location based CDN Details

Product

The operator can configure location-specific CDN details. The operator can specifiy if a channel has a country or network-specific CDN details using on network flag and URL builder Rules. URL builder redirects or returns the URL to the client on playout request to the correct CDN-based URL of the content being played based on the configuration in OPF.

Device Signon with access code using companion device application

Product

The feature allows a authorised companion device application to authorise another device in the users account via a generated registration code.

[ENTEL] TIVO TVA EPG Ingest with Chile & Peru Ratings Definition

Product

As part of ENTEL project, EPG metadata will be from TIVO provided in TVA format using XML. And requiring that TVA supplied ratings are split into both Chile and Peru rating schemes where applicable.

[UIC] Rails Implementation in UIC

Internal

This feature is to re-implement OpCon Rails in native UIC format

[UIC] Promotional Banner in Rails

Internal

The feature intends to deliver a simple and consistent approach within OpCon to allow an operator to add a pre-configured RAIL for promotional banner usage to a template. The pre-configured Rail is important as a freeform approach can be easy to misconfigure.

Google Assistant Channel Names / Numbers

Product

This feature aims to improve the accuracy of the search when used in conjunction with Google Assistant, focusing on alternative channel names / aliases and regionalised channel numbers.

Pass fuller metadata and activities into XRM

Product

XRM can use more data to make more informed decisions: 1 - Extended user activity reporting, 2 - Extended product/price metadata for BTV/VOD/Series/Season, 3 - Extended product/price metadata for Deeplink

A/B Testing

Internal

This feature is to allow the creation and execution of A/B tests within OPF.

XRM Personalised Search

Product

This feature is to utilize XRM search API to allow recommendations-weighted searching. App/3SS should be able to call our search API and get personalised results.

Client must be able to provide the search term as part of a request and a value to indicate the search engine to use. Search Service is integrated with XRM search. The default search engine to use is configurable at Platform Level.

[CPM Evolution] Move LTCU rules into CGS with CPM service layer refactoring

Internal

This feature is to move LTCU "at creation" business rules into CGS leaving remaining rules associated with workflow status in CPM BRE.

User-Rec Split

Internal

This feature is to break the User Recording Module into multiple deployable micro services by separating the concerns like User Based and non-User Based. This is based on the analysis of user-rec performance issues that has identified that some back-office processes, specifically in relation to series/event processing and it has an adverse impact on the ability of user-rec to serve client requests.

MDS - Metamorph BTV/Services

Internal

This feature is to add support to metamorph to handle the btv/services API. Metamorph will consume messages required for btv/services and push the requied data to MDS-MongoDB. This feature includes adding support for consumption of RMG messages to Metamorph.

Metamorph vod/nodes

Internal

This feature is to add support to metamorph to handle the vod/nodes API. Metamorph will consume messages required for vod/nodes and push the requied data to MDS-MongoDB

[4iG] User Recordings - RAILS Use Case Enhancements (inc. Sorting)

Product

Feature to extend the functionality of the User Recordings APIs, enabling 3SS user journeys to be completed in a more optimal manner.

[OPF] [ImageService] Deployment improvements

Internal

This feature is to fix all the ImageService deployment issues with Terraform and address the gaps.

[OPF][Security] Enforce volume encryption in IaC at creation time

Internal
This feature is to ensure that every volume created by Infra as Code is encrypted. This is to address the issue of Volumes that may contain sensitive data and therefore default encryption must be enforced, and not depend on an external factor like GAMI encryption.

[OPF][Security] Users on AWS Console must be able to view EKS nodes related information without requiring poweruser access

Internal

This feature is to address the problem of access to EKS information that is currently limited to powerusers. Several users need view access and it's not a good security practice to grant poweurser access for that purpose.

[OPF][Security] Ensure NLB do not expose TLS1.0

Internal

This feature is to address the issue of NLB (Network Load balancers) that wrongly expose that TLS1.0 supported on OpenTV deployments. This is now visible through a Tenable scan and in PowerBI reports. It is misleading for people analyzing the report.

[OPF] [Cost reduction] Migration of EBS volumes deployment from gp2 to gp3

Internal

Today, all OPF instances storage volumes are of type gp2. With the general availability of gp3 EBS storage type we can provision smaller volumes while maintaining high performance, at a cheaper cost. By migrating from gp2 to gp3 we expect to benefit from higher performance and scalability at a lower cost, being the cost reduction estimation of 20%. This feature is to update the OPF IaC to deploy all EBS volumes currently deployed as gp2 to gp3.

Analysis of notifications to downstream from CPM

Internal

This feature is to collect and analyze the notifications being sent downstream from CPM, to take action to remove/simplify spurious notifications.

Simplification of NodeLink dates

Internal

This feature is to remove the inheritance of dates from Editorial contents to NodeLinks. This will simplify the NodeLinks model and Notifications sent downstream.

Generalise DIP to include other EPG providers

Internal

This feature is to analyze the usage of DIP in other Customers (other than CLB) to simplify the data sent to CPM.

Compatibility matrix

OPF	Q2 : 24.26.STD0
SSP 24Q2GA ( 24.24.STD1 )
DWH (24 Q1)

List of new issues

The following issues are newly opened in this OPF3_24.xxSTD0 release.

List of known issues

The following issues are still open (not resolved) in this OPF3_23.50STD0 release.

List of resolved issues

The following are the Critical & High severity issues resolved as part of the OPF3 (23.50 STD0) release.

Deprecated APIs