Testing on multiple devices before release - simultanous solution (or tipps/tricks)

Is there a way to test multiple devices at once? Anyone using automation technics to make automatic tests before releasing a new version?

E.g. I'd like to test changing settings and see the visual result on multiple simulators at once. Or changing between a few setting configurations and check if all devices have enough memory to display all possible combinations... And so on.

Doing this manually after each change or improvement of a watchface is quite combersome...

Any tipps are appreciated as well

jim_m_58 over 5 years ago

Doing it one at a time is the only way unless you have multiple machines.

jim_m_58 over 5 years ago in reply to jim_m_58

Couple of things that may come in handy with WFs, are in the sim, you can do time simulation, where you can run through a day in a short amount of time. Do both 12 and 24 hr modes, to make sure nothing gets clipped on the edges, and try both low and high power mode.

Also there's the heat map for the venu in low power mode.

Michael over 5 years ago in reply to jim_m_58

I was hoping that I can start multiple sim instances and push settings to those instances via the command line. Or to be able to start sim instances inside VMs and do some automatic tests with the instances in there via command line...

Deploying to those devices could be done by creating an iq file and again pushing it to all the sim instances via command line...

Just ideas that came to my mind that should be possible if following would be possilbe:

start multiple sim instances
support command line commands

jim_m_58 over 5 years ago in reply to Michael

Not possible.

One thing that helps is understanding which devices are just varients of others. For example, for a WF, All MARQ devices are the same. The va4/va4s are the same as some legacy watches, like Rey and Darth Vader. If something works on the fenix5, it will work on the f5s and f5x (well, except "real time" HR on the f5x), etc

peterdedecker over 5 years ago in reply to jim_m_58

A way to make it work could be multiple vms or multiple docker containers next to each other and use sendkey commands to the right containers ... but it would be quite involved to make it work.

Michael over 5 years ago in reply to peterdedecker

without at least some command line command support it's really too much work...

jim_m_58 over 5 years ago in reply to Michael

Check out monkeydo in the Programmer's Guide. But you would still need different windows VMs