Announcing the Stb-tester CAMERA for Smart TVs and Mobile Devices.
Watch the short video!
Stb-tester news, product announcements & testing topics.
27 Feb 2017.
Software update v27.4 for the stb-tester ONE is now available. It includes a
more convenient configuration system for large test farms, a new REST API for
searching past test results, support for controlling Android devices without a
USB connection, and more.
21 Feb 2017.
There are several mature open source and proprietary tools for testing the user
interface of mobile apps on Android and iOS devices, but there aren’t many
solutions for internet service providers or video-on-demand streaming services
who want to test video playback on real mobile devices to validate their
end-to-end video delivery. In this article I’ll discuss various ways of getting
video frames from a mobile device for automated testing, and the advantages and
trade-offs of each approach.
23 Jan 2017.
Software update v27.3 for the stb-tester ONE is now available. It adds support
for the Sony PlayStation 3 & 4, Android devices, and more!
05 Jan 2017.
To test a PS4 app you need a mechanism to control the PS4 and a way to get
feedback to check that your app is behaving as it should.
12 Dec 2016.
The stb-tester camera allows you to test the user interface of devices that
don’t have an HDMI output, such as Smart TVs and mobile devices.
28 Oct 2016.
A Serial Terminal Server makes a serial connection available over the network,
so that your application can access your devices without a direct serial
connection. Typically this is used to establish a bi-directional connection
between networked applications and older industrial equipment. In this article
we will focus on a much simpler use case: Capturing serial logs, where we only
need communication in one direction — a common use case when testing set-top
04 Oct 2016.
Software update v26.6 for the stb-tester ONE is now available. It contains a
JPEG thumbnail alternative to the Flash video in the web interface, and a
bugfix for inode exhaustion on the stb-tester ONE’s test-results partition.
20 Sep 2016.
Selenium is a test automation tool for web applications. It tests your
web app by looking at the DOM – you can check that your web page contains a
particular element like a div or a button, identified by id or css selector or
xpath expression; once the element is located, you can check that it contains a
particular text or other elements. However you can’t really check what your web
app looks like. If you have complex CSS it can be all too easy to introduce
unintended defects in your app’s visual appearance.
08 Aug 2016.
The stb-tester team will be at the IBC exhibition in Amsterdam 9-13 September
22 Jul 2016.
Software update v26.2 for the stb-tester ONE is now available, with new
features for managing & monitoring large test farms.
13 Jul 2016.
Stb-tester v26 is now available, with support for frame-accurate performance
05 Jul 2016.
Updated 17 May 2017 with figures for our new hardware’s accuracy.
29 Jun 2016.
If you have already automated one or more testcases, run them! Ideally run them
every time a developer commits a change to the system-under-test. If that isn’t
possible, at least run the tests against nightly builds. Run! Your! Tests!
21 Jun 2016.
We have just published an extensive tutorial about our recommended workflow for
implementing automated test scripts, using stbt.FrameObject to extract
information from the screen, using stbt lint and stbt auto-selftest to
test your scripts locally, and using stbt-docker to develop on Mac or
03 Jun 2016.
Stb-tester v25 is now available, with features that significantly improve the
maintenance cost of your test scripts:
27 May 2016.
Software update v24.8 for the stb-tester ONE is now available. It fixes a
regression introduced in v24.7 that caused the stb-tester ONE’s old USB
infrared transmitter to fail for signals longer than 125 milliseconds.
26 May 2016.
Software update v24.7 for the stb-tester ONE is now available.
26 May 2016.
This is a technical report on our investigation into an intermittent problem
with the stb-tester ONE’s infrared transmitter.
06 May 2016.
How to create a custom remote control image for the stb-tester ONE’s “manual
control” web interface:
22 Apr 2016.
Software update v24.5 for the stb-tester ONE is now available. This release
delivers a minor UI improvement, and a bugfix that affects a small number of
29 Feb 2016.
We have just published three videos showcasing the stb-tester ONE, including a
detailed guide for measuring channel change times on a set-top box:
11 Feb 2016.
Software update v24.4 for the stb-tester ONE is now available, with the ability
to run tests from any git branch, and several bugfixes.
20 Jan 2016.
Software update v24.3 for the stb-tester ONE is now available. This includes
better feedback when you have errors in your infrared configuration file, and
other small usability improvements & bugfixes.
14 Jan 2016.
Stb-tester v24 is now available, with many small Python API improvements and
11 Jan 2016.
Software update v23.7 for the stb-tester ONE is now available. This includes a new test-results interface with much better search capabilities, plus some minor fixes & updates.
18 Dec 2015.
In November 2015 YouView launched on a range of Sony Bravia televisions across
the UK. The biggest technical challenges of the project were in the
integration, with frequent releases from YouView, Sony, MediaTek, and Google.
16 Dec 2015.
Software update v23.6 for the stb-tester ONE is now available. This is a bugfix release.
02 Dec 2015.
Stb-tester.com is pleased to announce that DTVKit will be using our
stb-tester tool as part of their test automation strategy, and we will
be providing our expertise and support as a Partner Member of DTVKit.
09 Nov 2015.
Software update v23.5 for the stb-tester ONE is now available. It has a
technology preview of upcoming improvements to the results viewer, as well as
24 Sep 2015.
In the previous blog post we discussed the frame object pattern and how it
could lead to greater agility and lower maintenance costs thanks to improved
self-testability. This blog post discusses a technique to get the maximum
value from this testability at near-zero cost.
08 Sep 2015.
In the previous blog post we discussed the Page Object pattern and how it
could be used to improve the readability of your test scripts. In this blog
post we introduce the Frame Object pattern, a specialisation of the Page Object
pattern that can be especially effective in stb-tester’s style of black-box UI
testing. Frame Objects can reduce the maintenance cost of your test-packs,
particularly when the UI-under-test changes.
02 Sep 2015.
Often you will hear us recommend that you should structure your test-packs as a
set of library functions, plus test-cases that use those library functions. In
this blog post we attempt to make this recommendation more concrete by
demonstrating how to apply the “page object” pattern when writing
25 Aug 2015.
In this blog post we use the OpenCV
function to improve the robustness of test helper functions for dynamic UIs.
10 Jul 2015.
Stb-tester v23 is now available, with a new option to run your testcases in
random order, aiming to spend approximately the same amount of time in each
27 Jun 2015.
v22.5 for the stb-tester ONE is now available. It provides a REST API to
retrieve detailed test results and artifacts, intended for integrating
the stb-tester ONE with external reporting systems.
10 Jun 2015.
v22.4 for the stb-tester ONE is now available.
14 May 2015.
v22.2 for the stb-tester ONE is now available.
31 Mar 2015.
Stb-tester v22 is now available.
31 Mar 2015.
Up until now, stb-tester testcases were Python scripts with one testcase per
file, and you referred to your testcases by the filename.
26 Mar 2015.
We have overhauled the stb-tester Python API reference documentation, with more
examples, introductory material, a categorised index, and a search function.
25 Sep 2014.
stbt batch run works really well for stress-testing and soak-testing, but
it’s lacking a few features that would be useful for functional acceptance
testing: Run each test once, then re-run each failing test; run the tests in a
random order or specify ordering dependencies between tests; update an external
bug database with the results. Or for a continuous integration service, only
run the fast tests and don’t fail the build if a test fails due to a known
defect. The list goes on.
22 Sep 2014.
wait_for_match function works well enough, but what if you want
to wait for a UI element to disappear? Or when you want to check that 2
different UI elements are present in the same frame? Or when you just want to
know if the element is present or not, without raising an exception? An
addition to stb-tester’s Python API, due in stb-tester 0.21, will make this
23 Aug 2014.
Do you wish that your stb-tester test farm was as easy to set up as
Travis CI? Want a neat way of specifying your test script’s dependencies? Or
maybe you want to run stb-tester from your Windows PC? The upcoming
service command solves these problems.
30 Jul 2014.
Stb-tester.com Ltd is currently working with a global TV manufacturer to provide
testing services for their latest development project. To support this work we
have developed a lot of exciting new features in stb-tester.
10 Jun 2014.
- TL;DR version:
- stb-tester reqires a LIRC config file to know how to translate key names
into IR pulses.
irrecord can be used to create them by recording IR
signals but can have difficulty sometimes. In those cases you can provide
additional information to make recording succeed which can be determined
from the output of
xmode2 and by consulting the lirc config
10 Jun 2014.
stb-tester 0.20 has been released. The key new developments are:
16 May 2014.
A Continuous Integration (CI) system, which runs your automated tests against
every change made to your source code, is an important part of every Agile
development process. With stb-tester your CI system can run integration tests
on the real target device. As a demonstration we have set up stb-tester CI
for a simple “Hello World” Android app at this git repo.
14 Apr 2014.
- TL;DR version:
stbt.ocr’s misreadings aren’t due to it not being familiar with your
fonts. The root cause is that the OCR system we use (tesseract) is
intended for reading the printed word. With this new understanding we’ve
made improvements to OCR resulting in a 12× reduction of errors. This will
be in the next stb-tester release.
09 Apr 2014.
stb-tester 0.19.1 has been released. The only change since 0.19 is a fix to
the Fedora packages to make them installable on Fedora 19. See the release
notes for (not much) more information.
04 Apr 2014.
stb-tester 0.19 has been released. This is a beta release intended to allow
for wider testing rather than production use.
28 Jan 2014.
stb-tester 0.18 has been released with support for OCR and enhancements to the test runner - now called
17 Dec 2013.
stb-tester 0.17 has been released. Among other improvementes image matching is now 2-6x faster.
12 Dec 2013.
stb-tester maintainer and original author David Röthlisberger gave a presentation on stb-tester at the GStreamer conference in Edinburgh in October. It includes:
01 May 2013.
stb-tester maintainer and original author David Röthlisberger gave a presentation on how stb-tester was built and an overview of some of the things you can achieve with stb-tester. See the video on YouTube.