Ofcom today published its second report on the quality of live subtitles in UK TV programmes. The report shows that broadcasters are beginning to make improvements in some areas of subtitling. However, it finds that some issues - such as the delays between speech and the corresponding subtitle appearing on screen, known as latency - remain a problem.
Ofcom welcomes the fact that broadcasters are now making greater use of block subtitles in live programmes. These allow several words to appear at once as a single block and are easier and quicker for viewers to read than scrolling subtitles.
Last year, Ofcom required broadcasters to start measuring the quality of live TV subtitles. This work is intended to identify areas where broadcasters can improve subtitles to benefit viewers.
Today’s report is the second of four Ofcom is publishing over two years. Each report samples data from broadcasters on the quality of live TV subtitles - measuring their accuracy, speed and latency. The first report was published in April 2014.
The latest report finds that delays in subtitles reaching the screen continue to be a problem for viewers. For example, when programmes with live subtitles have frequent changes of scene - such as on Channel 4’s Gogglebox - viewers can find it difficult to know which scene the subtitles relate to.
Poor latency is one of the most frustrating aspects of live subtitling for TV viewers, who say that these delays result in a disjointed viewing experience.
Samples from BBC, ITV, Channel 4, Channel 5 and Sky programmes showed that the average (median) latency was 5.8 seconds (Figure 1), which exceeds the recommended guideline of a maximum 3 seconds delay. This is a 0.2 second increase in average latency since our first report.
Delays of up to 21 seconds were recorded, and only four samples out of the 72 measured had a median latency of less than 3 seconds.
Figure 1: Median latency of subtitles by broadcaster and genre Higher bars represent an inferior viewing experience
Source: Ofcom/broadcasters Note: not all broadcasters had all three live genres in the sample.
The accuracy of subtitling was rated as generally good by external reviewers auditing the data on behalf of Ofcom, although the quality varied. Ofcom’s external reviewers advise that a 98% accuracy score is seen as an acceptable standard (Figure 2).
Ofcom understands that broadcasters are now making greater efforts to provide subtitlers with advance information, such as running orders, pre-recorded film segments and scripts, on live programmes such as the news.
This may explain why more samples in this second reporting period showed very good to excellent (more than 99%) accuracy than the first set of data. However, the proportion of samples that failed to meet the 98% quality threshold rose from 20% to 25%.
Figure 2: Median accuracy of subtitles by broadcaster and genre Higher bars represent a better viewing experience
Source: Ofcom/broadcasters. Note: not all broadcasters had all three live genres in the sample.
In general, the programme subtitles sampled for the purposes of our second report met Ofcom’s current guidelines, which recommend a maximum speed of 160 - 180 words per minute.
The average speed of the subtitles (143 words per minute) was well below the recommended maximum, though there were some instances where speeds were unacceptably high. Speeds above the recommended maximum make it more difficult for viewers to read subtitles while watching the images on the screen.
Ofcom’s first report on subtitles encouraged broadcasters to make greater use of block subtitles in live programmes. These allow several words to appear at once as a single block and are easier and quicker for viewers to read than scrolling subtitles.
Today’s report finds that broadcasters are now using more pre-prepared block subtitling in live programmes, which is welcomed by Ofcom.
However, pre-recorded subtitles being cued out too quickly caused some issues for viewers. Some of the programmes monitored showed incomprehensible speeds of up to 460 words per minute, far higher than Ofcom’s recommended 160 - 180 words per minute.Ofcom understands that software can be used to limit the speeds at which these subtitles are cued, so that it remains comprehensible to viewers. Ofcom expects broadcasters to take steps to resolve these teething problems.
By analysing subtitles broadcast over two years, Ofcom aims to help broadcasters identify opportunities to improve the experience for viewers who use subtitles. We also plan to use the data from the four sets of samples to review our guidelines on subtitling.
Ofcom expects to publish its third report on live subtitles in April 2015, drawing on samples taken from programmes broadcast in October and November 2014.