Thursday, 28 May 2009

TestComplete 7 - complete !

Okay, although not in detail and in my spare time (at nFocus that's a rare thing) my review of TestComplete7 and the new keyword functionality is complete.

So what do I think, well, as a tool in its own right, it is great, it covers a multitude of different situations and technologies (for a great price too) but for me, it just doesn't cut it, for these reasons:

  • I found it complicated to navigate, this is a tool that needs a lot of learning

  • I couldn't let my non technical testers loose on this even with the keyword-driven tests

  • the mapping tool is a bit difficult to navigate

This wasn't really supposed to be a side by side comparison between Axe and TestComplete7 but I just found myself constantly comparing the two.

For my money, using something like Excel with say the Axe toolset is a much more attractive proposition, I like the fact that Axe uses Excel, I can show my non technical testers how to fill in the spreadsheets and away they go! Object mapping can be a pain in Axe (depending on which automation toolset you are using) but at least it enforces you to be methodical and think carefully about the logical names you might want to use.

At the end of the day, picking a toolset to use when employing automated testing is always difficult and one tool that wins in one situation will lose in another. There isn’t a “one size fits all” automation tool. I think that TestComplete7 would get my vote if I was a solo tester in an organisation where I need to test a number of different smaller apps in different technologies (web app, Java client, Windows client, pda app, WPF client etc).

Tuesday, 19 May 2009

AutomatedQA Introduces TestComplete 7

AutomatedQA just released it's latest version of it's TestComplete offering - version 7 !

So what's new? seems that the biggest news is the addition of it's keyword tests or otherwise known as keyword-driven tests. It is clearly trying to compete with some of the test automation frameworks such as Axe from Odin Technology. I'm gonna be giving this version a trial over the next couple of days and will report back on my findings.

Also of note is that you can test applications that run on PDAs, PocketPCs and smartphones - no iPhone support yet but hey it's a good start :)

Watch this space for an update on the trial!

Wednesday, 13 May 2009

iPhone apps - iTest...uTest, can anyone Test?

A couple of weeks ago saw the 1 billionth download from the Apple App Store and in just 9 short months this is quite some achievement but what impact does this have on the testing world. Well it seems that more and more business apps are being produced for the iPhone, apps that need testing! So how do we test these apps? With difficulty it would appear! The answer to this would really depend on what sort of app it is we are testing, if it is a browser app that is designed for the safari browser on the iPhone then there are a number of solutions:

iBBDemo - Blackbaud iPhone Browser Simulator:

and - iPhone Simulator:

If, however, we are to test a native iPhone app, then this proves to be a little more tricky. The only way to really test it before it goes live is on an actual iPhone itself or from within the development environment. There does not appear to be any emulators out there on the windows platform right now and with the absence of any sort of controller you are going to be limited to just manual testing. If anyone knows of a good simulator or test automation tools for iPhone apps, then let me know!