The following tables define the common terms used with Tableau reports and the TV Analytics product.
|
Term |
Definition |
|---|---|
|
Active Account |
Any account with any activity during the period selected for filtering. |
|
Active Session |
Any session created without an end of the session, sign out or another end-of-session event in the last 24 hours. |
|
App Session |
Application session from the start of the app to close/stop/exit or time out. |
|
App name |
Supplied by the client a text value to indicate the application name, if not supplied then blank. |
|
Audience Share |
Percentage of the total 'audience' / viewer/devices that are watching the specific piece of content at any one time. For example, if 10 connected devices stream 4 events, and 5 of them are watching event one, then event one has an audience share of 50% . |
|
Avg content completion |
Take the max position value per device, account, and content where the position is >5% of the total run time. add them all up, divide by the number of unique views, count one for each unique device, account, and content where the position is >5% |
|
Best Devices Worst Devices Device QOE |
Best Devices = those devices scoring in the top 10% of devices based on the following criteria. Worst Devices = those devices scoring in the bottom 10% of all devices based on the following criteria. Devices are allocated a score as follows. Buffering event ratio, which uses -1, 0, and 1 to represent poor, moderate, and good states respectively:
Error ratio, which uses -2, 0, and 2 to represent poor, moderate, and good conditions respectively:
Average bitrate, which uses -1, 0, and 1 to indicate suboptimal, acceptable, and excellent levels respectively:
These values are then multiplied by the ratio of the specific devices to overall devices in use to avoid distorting the results based on uncommon devices in use. |
|
Bitrate Downgrade |
When the playout bitrate ‘drops’ is lower than the preceding reported bitrate for the same content stream. Example: a drop from a 3.5Mbit streaming profile to a 2.5Mbit profile is considered a downgrade. This is per device per content; it's not a downgrade if it is a different piece of content or at a different time. |
|
Avg Bitrate Downgrades |
The average number of times that there was a bitrate downgrade per unit of time. |
|
Buffering Rate |
Number of buffering events per unit of time. |
|
Buffering Ratio |
Percentage of time during which the playback was buffering per unit of time. Example: 33% of buffering ratio means that during 15 minutes of playback, the video was buffering for 5 minutes and playing for 10 minutes. |
|
Collection Timestamp |
The timestamp at which the collection of data is happening. |
|
Concurrent Devices |
The total number of active users at a given time or between a given time and date range as specified in the report filter. A total of:
|
|
Device Type Display |
A combination of OS + hardware type + model to create the string displayed. |
|
Device Type Groupings / Filtering |
Device types reported, as defined in the OPF 3.x documentation. For example, Android, iOS, Browser, Fire, Other, Managed (STB). |
|
Live Audience |
The number of unique devices currently consuming live content. A count of the total active devices streaming a specific piece of content at a specific time, e.g. over 24 hours or 30 minutes. The total live audience would be a count of all devices with a playback metric in the last 10 minutes. |
|
Most Popular Channels |
The channel(s) with the most views over the filtered time period. |
|
Peak Audience Share |
The highest audience share as obtained by the channel/event in the time frame filtered on the dashboard. |
|
Peak Viewers |
The count is related to the above metric. The peak number of devices consuming content at the same time. |
|
Peak Viewing Times |
The time of day when most plays are taking place, regardless of content type. To indicate when the highest amount of content is being consumed across the platform. Presented as :
|
|
Playback Session |
Individual playout session – a unique id provided by the client or SDK for the specific piece of content playback activity. |
|
Playback Consumption |
One of the following, in this order of precedence:
|
|
Position |
The position in seconds of the current view, e.g. if a user watches content for 10 minutes, the value reported should be 600 |
|
Progress |
The progress through a piece of content, e.g. content with a 100 minute run time where a user views 10 minutes is 10% |
|
Started but not finished |
Failure to complete, track content that users start watching > 5% of content duration but fail to finish < 90% of the content duration |
|
Suspended Account |
Any account that has had a suspended status over the time frame. |
|
timestamp |
The timestamp at which the session is happening, provided by the client device. |
|
User |
Unique device used to represent the concept of an individual consuming content through one device, e.g. TV, phone |
|
Viewer Active Viewer Active Views |
A user (Active connected device) that is consuming content on the platform at a specific time or over a time period as driven by the filter on the dashboard. |
|
Views |
Content that has been watched > 75% of the content duration. Any consumption of content is a view regardless of viewing type/time slot etc. Where we do not have progress or position reported by the client then we count any viewing time as a full view – that could be a watch or playout, or play or playback metric. |
|
Watched Total |
Value of time watching content, any content, any user, any device. Sum of all minutes/seconds of consumption. |
|
Failed Sessions |
A failed session is any session where its total_viewing_seconds <= 0 OR total_buffering_seconds <= 0 |
|
Time to start |
Amount of time from the user pressing the Play button until the first frame of the video is displayed. It generally includes the first buffering event. |
|
Buffering Time |
Number of seconds during which the playback was buffering or stalled seen by the end user as a |
Definition of Quality of Experience
For the overall quality of experience (QOE) and data specific QOE visualisations within Tableau, we use three primary colours to display the QOE rating:
|
Metric |
Green |
Orange |
Red |
|---|---|---|---|
|
Overall QOE
|
< 2 errors avg per device and avg time to start < 2000ms and < 0.5 avg buffering ratio |
=>2 & <= 10 errors avg per device OR avg time to start >= 2000 < 3000ms OR > 0.5 <=3% buffering ratio |
> 10 errors avg per device OR avg time to start > 3000ms OR > 3% avg buffering ratio |
|
Session QOE |
As per overall but limited to the playout session timeframe |
As per overall but limited to the playout session timeframe |
As per overall but limited to the playout session timeframe |
|
Device QOE |
See definition in the table above |
See definition in the table above |
See definition in the table above |
|
Buffering Ratio |
0.5% per 15min |
> 0.5 <=3% per 15 min |
>3% per 15 min |
|
Buffering Rate |
< 1 per 15 min |
>=1 <=2 per 15 min |
> 2 per 15 min |
|
Avg Bitrate |
>= 3mbps |
>=1 < 3mbps |
<1mbps |
|
Framedrops |
<1 |
>=1 < 3 |
>3 |
|
Bitrate Downgrades |
5 per 15 min |
>5 < 10 per 15 min |
> 10 per 15 mins |
|
Time to start |
< 2000ms |
>= 2000 < 3000ms |
> 3000ms |
|
Failed Sessions |
< 1 per 15 min |
>=1 < 2 per 15 min |
>2 per 15 min |
|
Total Active Users |
> previous 24 hours |
= previous 24 hours - 10% |
< previous 24 hours |
|
Total new users |
> previous 24 hours |
= previous 24 hours - 10% |
< previous 24 hours |
|
failed sign on's |
= 0 |
>0 < 10 |
>10 |
|
Daily consumption live |
> previous 24 hours |
= previous 24 hours - 10% |
< previous 24 hours |
|
Daily consumption vod |
> previous 24 hours |
= previous 24 hours - 10% |
< previous 24 hours |