45 Commits (a2e48a5c044e54e98a03ff28db22eda74e5d8492)

Author SHA1 Message Date
Joachim Klein 484cef6c43 explicit.MDPSparse: fix mvMultRewJacMinMaxSingle to properly handle zero-reward selfloops 9 years ago
Joachim Klein 730785ea5f explicit.MDPSparse: simplify code for getTransitionsIterator 9 years ago
Joachim Klein 2fe2f918b3 explicit.MDPSparse: add constructor from arbitrary MDP [with Steffen Maercker] 9 years ago
Joachim Klein 985a939102 refactor explicit.Model/NondetModel, getSuccessorsIterator: new abstract method getSuccessors, getSuccessorsIterator becomes default method 9 years ago
Dave Parker ebd19aa9d6 Fix bug (two bugs, actually) in Gauss-Seidel solution of MDP expected reward to a target for models with self-loops. 10 years ago
Dave Parker 9729c78b3e Inefficiency in precomputatino routines in explicit engine (spotted by Steffen Marcker). 11 years ago
Dave Parker a18d28a17b Refactor: use IterableStateSet to simplify loops [Joachim Klein]. 11 years ago
Dave Parker 7c687d5195 Bugfix in MDPSparse (from Joachim Klein). 12 years ago
Dave Parker 89fab7269a Bug fix in getSuccessorsIterator(s) in SubNondetModel (showed up as regression test failure in prism-games-heuristics-merge), plus required missing method getSuccessorsIterator(s,i) in NondetModel. 12 years ago
Dave Parker 4a29528714 Bug fix: missing state rewards in mvMultRewMinMaxSingleChoices methods (showed up on mdps/reach/mdp_simple.nm regression test). 12 years ago
Dave Parker 440b539364 Bugfix in optimal strategy check for reward properties (showing up as bug in policy iteration). 13 years ago
Dave Parker 4d3d52edaf Policy iteration for reachability reward problems (explicit engine). 13 years ago
Dave Parker ff11760860 Update strategy generation in explicit engine to distinguish between: -1 (unknown), -2 (arbitrary), -3 (unreachable). 13 years ago
Dave Parker b06df8c756 Fixes in strategy generation for expected rewards in explicit engine (should only check for strict changes in max case). 13 years ago
Dave Parker 1c42335bcf Some refactoring of explicit model classes, to introduce NondetModel interface. 13 years ago
Dave Parker 5a1186c177 Strategy synthesis for reach rewards in the explicit engine: choices for inf states and do export. 13 years ago
Dave Parker 65a6464b32 Strategy synthesis for reach rewards in the explicit engine (no precomputation yet). 13 years ago
Dave Parker 8b6d5d17a8 Improvements to strategy generation for MDP reachability in explicit engine, notably algorithms for precomputation. Also split Prob1 into Prob1A and Prob1E for efficiency reasons. 13 years ago
Dave Parker 51bf20f1f6 Add strategy generation to MDP Gauss-Seidel (explicit). 13 years ago
Dave Parker c02983ea26 Small code tidies. 13 years ago
Dave Parker 064356d11f Rename adversary to strategy in explicit MDP model checking + align with prism-games. 13 years ago
Dave Parker 99d2139f55 Add getSuccessorsIterator to explicit Model interface. 14 years ago
Dave Parker 80f8605a1e Deadlock info preserved in explicit model copies. 14 years ago
Dave Parker a218d09b2b * Continued major changes to PRISM API 14 years ago
Dave Parker a869bbeec0 Gauss-Seidel val iter for cumulative rewards in explicit engine. 15 years ago
Dave Parker 9ba97fe1fc Add MDPExplicit class to capture shared from MDPSimple/MDPSparse (also a few fixes to same thing done previously for DTMCs). 15 years ago
Dave Parker d54e92533c Another fix for adv gen in explicit engine: min probs should not be treated as for max probs. 15 years ago
Dave Parker 0bb97718c1 Adv gen for rewards in explicit engine (from prism-games). 15 years ago
Dave Parker f49ce60f1b Fixes in explicit MDP adversary generation (min case can give wrong answer). 15 years ago
Dave Parker 1076e70f9f Bug fix in explicit-state MDP adversary generation (MDPSparse). 15 years ago
Dave Parker c5e417d292 Bugfix in MDPSparse: Copy constructors handle null (absent) action info. 15 years ago
Dave Parker bedfccb2ec Re-arrangement of explicit model classes: 15 years ago
Dave Parker 6be5202551 Slight tweak in MDP interface (to match STPG). 15 years ago
Dave Parker ea9463344b Update to (explicit) MDP interface. 15 years ago
Dave Parker 80b693fee8 Added state rewards into MDP model checking in explicit engine. 15 years ago
Dave Parker e5b7ad597e Expansion of transition-matrix-export functionality for explicit engine. 15 years ago
Dave Parker 25b8626a51 Code tidy. 15 years ago
Dave Parker 3403e8b417 Some bugfixes and adds in explicit MDP classes, mainly relating to action labels. 15 years ago
Dave Parker edab23b581 More updates to explicit library: 15 years ago
Dave Parker b8a78c4031 Updates to explicit engine from prism-qar (Vojta): 15 years ago
Dave Parker 24caab6c97 Credit/copyright for Christian von Essen. 15 years ago
Dave Parker e33c2b1301 Added action names to other MDP explicit exports (dot, PRISM lang). 15 years ago
Dave Parker ac4eac3719 Action names included in explicit MDP export to tra file (from prism-qar). 15 years ago
Dave Parker 85147f1a71 Explicit engine improvements, mainly MDP rewards: 15 years ago
Dave Parker 52d2d21447 Update to newest version of explicit code (from prism-qar) plus -explicit switch for command-line and MDP solution settings. 15 years ago