I have finally come to terms with the TestLink API and have bashed out an automated test runner written in perl (which I hope to clean up and post in the next few days, there don’t seem to be many (or any) examples of this in the wild).<\/p>\n
After getting nightly automated testing running, I wanted a very simple script which would, for each test case in a given test plan, compare the last and the second to last result and print a warning if they were different. Long term I will have better automated reporting, but our test script library is still so new that it’s not really news that a lot of them are failing. What would be news is if a specific test case passed two nights ago but failed last night.<\/p>\n
<\/p>\n
This seemed like a really easy thing to do, but I couldn’t find an API function to support it. The closest thing I could find was I hope to wrap all of these TestLink patches up into a better place at some point in the future, but for now it feels better to just get the code out where Google can find it as fast as possible.<\/p>\n Here’s the patch for adding the Update 2012-05-08<\/strong>: There’s a real, usable-with-patch-command patch file for this change<\/a> available at the github repo I started for my TestLink changes<\/a>.<\/p><\/blockquote>\n This function suffers from a few warts, but they are ones mostly inherited from I have finally come to terms with the TestLink API and have bashed out an automated test runner written in perl (which I hope to clean up and post in the next few days, there don’t seem to be many … Continue reading getLastExecutionResult()<\/code>, but that only gave me the last execution, it didn’t give me the execution history I needed. I also could have leveraged the fact that getTestCasesForTestPlan()<\/code> includes each case’s last execution status to have done in-place alarming if the new status didn’t match the old status, but I felt like that would limit my ability to expand reporting in the future. I toyed with the idea of getting the info out of the DB directly, but decided instead of just implement the API function I needed. It’s mostly a copy of getLastExecutionResult()<\/code>, but it has an added parameter numexecs<\/code> which allows you to specify how many executions to return.<\/p>\ngetExecutionResults()<\/code> function:<\/p>\n\r\n--- xmlrpc.class.php\t(revision 268)\r\n+++ xmlrpc.class.php\t(revision 270)\r\n@@ -176,6 +176,7 @@\r\n \tpublic static $testSuiteNameParamName = "testsuitename";\r\n \tpublic static $timeStampParamName = "timestamp";\r\n public static $titleParamName = "title";\r\n+ public static $numexecsParamName = "numexecs";\r\n \r\n \r\n public static $urgencyParamName = "urgency";\r\n@@ -255,6 +256,7 @@\r\n \t 'tl.getBuildsForTestPlan' => 'this:getBuildsForTestPlan',\r\n \t 'tl.getLatestBuildForTestPlan' => 'this:getLatestBuildForTestPlan',\t\r\n 'tl.getLastExecutionResult' => 'this:getLastExecutionResult',\r\n+ 'tl.getExecutionResults' => 'this:getExecutionResults',\r\n \t 'tl.getTestSuitesForTestPlan' => 'this:getTestSuitesForTestPlan',\r\n \t 'tl.getTestSuitesForTestSuite' => 'this:getTestSuitesForTestSuite',\r\n \t 'tl.getTestCasesForTestSuite'\t=> 'this:getTestCasesForTestSuite',\r\n@@ -1220,8 +1222,78 @@\r\n \r\n \t\treturn $maxbuild;\r\n \t}\r\n-\t\r\n+\r\n \t\/**\r\n+\t * Gets the result of LAST EXECUTION for a particular testcase \r\n+\t * on a test plan, but WITHOUT checking for a particular build\r\n+\t *\r\n+\t * @param struct $args\r\n+\t * @param string $args["devKey"]\r\n+\t * @param int $args["tplanid"]\r\n+\t * @param int $args["testcaseid"]: optional, if does not is present \r\n+\t * testcaseexternalid must be present\r\n+\t *\r\n+\t * @param int $args["testcaseexternalid"]: optional, if does not is present \r\n+\t * testcaseid must be present\r\n+\t * @param int $args["numexecs"]: optional. If set, number of cases to\r\n+\t * return. If unset, all will be returned\r\n+\t *\r\n+\t * @return mixed $resultInfo\r\n+\t * if execution found, array with these keys:\r\n+\t * id (execution id),build_id,tester_id,execution_ts,\r\n+\t * status,testplan_id,tcversion_id,tcversion_number,\r\n+\t * execution_type,notes.\r\n+\t *\r\n+\t * if test case has not been execute,\r\n+\t * array('id' => -1)\r\n+\t *\r\n+\t * @access public\r\n+\t *\/\r\n+\tpublic function getExecutionResults($args)\r\n+\t{\r\n+\t\t$operation=__FUNCTION__;\r\n+\t\t$msg_prefix="({$operation}) - ";\r\n+\t\t\r\n+\t\t$this->_setArgs($args);\r\n+\t\t$resultInfo = array();\r\n+\t\t$status_ok=true;\r\n+\t\t\r\n+\t\t\/\/ Checks are done in order\r\n+\t\t$checkFunctions = array('authenticate','checkTestPlanID','checkTestCaseIdentity');\r\n+\t\t\r\n+\t\t$status_ok=$this->_runChecks($checkFunctions,$msg_prefix) && \r\n+\t\t $this->_checkTCIDAndTPIDValid(null,$msg_prefix) &&\r\n+\t\t $this->userHasRight("mgt_view_tc"); \r\n+\t\t\r\n+\t\tif( $status_ok )\r\n+\t\t{\r\n+\t\t\t\/\/ get all, then return last\r\n+\t\t\t$sql = " SELECT * FROM {$this->tables['executions']} " .\r\n+\t\t\t " WHERE testplan_id = {$this->args[self::$testPlanIDParamName]} " .\r\n+\t\t\t " AND tcversion_id IN (" .\r\n+\t\t\t " SELECT id FROM {$this->tables['nodes_hierarchy']} " .\r\n+\t\t\t " WHERE parent_id = {$this->args[self::$testCaseIDParamName]})" .\r\n+\t\t\t " ORDER BY id DESC";\r\n+\r\n+\t\t\t$limit = $this->args[self::$numexecsParamName] > 0 ? $this->args[self::$numexecsParamName] : -1;\r\n+\t\t\t$records = $this->dbObj->get_recordset($sql, null, $limit);\r\n+\t\t\t\r\n+\t\t\tif(null == $records)\r\n+\t\t\t{\r\n+\t\t\t\t\/\/ has not been executed\r\n+\t\t\t\t\/\/ execution id = -1 => test case has not been runned.\r\n+\t\t\t\t$resultInfo[]=array('id' => -1);\r\n+\t\t\t} \r\n+\t\t\telse\r\n+\t\t\t{\r\n+\t\t\t\t$resultInfo = $records;\r\n+\t\t\t}\r\n+\t\t}\r\n+\t\t\r\n+\t\treturn $status_ok ? $resultInfo : $this->errors;\r\n+\t}\r\n+\r\n+\t\/**\r\n * Gets the result of LAST EXECUTION for a particular testcase \r\n * on a test plan, but WITHOUT checking for a particular build\r\n *\r\n<\/pre>\ngetLastExecutionResult()<\/code>. If I were to polish this up (beyond my normal TestLink API beefs like some sort of standardized return format), I would definitely add optional buildid<\/code> and platformid<\/code> parameters so you could narrow down the executions you’re looking for even more. But that’s a problem for another day…<\/p>\n","protected":false},"excerpt":{"rendered":"