56 Commits (4fe35ae937455fef1f6166190e8dd5b5c4308c50)

Author SHA1 Message Date
Joachim Klein 9b5245f04f explicit DTMCSimple, MDPSimple refactor: remove mv... specialisations so the default methods from DTMC/MDP are used 9 years ago
Joachim Klein ae1bbd379e explicit.MDPSimple: remove specializations for prob0/prob1, use default methods from explicit.MDP 9 years ago
Joachim Klein 985a939102 refactor explicit.Model/NondetModel, getSuccessorsIterator: new abstract method getSuccessors, getSuccessorsIterator becomes default method 9 years ago
Dave Parker ebd19aa9d6 Fix bug (two bugs, actually) in Gauss-Seidel solution of MDP expected reward to a target for models with self-loops. 10 years ago
Dave Parker 81451753d1 Bug fix for explicit engine model import - we should not assume that the initial state is 0. This also highlights a bug that ModelExplicit should store initial states as a state, not a list, but that issue is not fixed here. 10 years ago
Joachim Klein d4ffeac654 explicit.MDPSimple: more flexible buildFromPrismExplicit() [with Steffen Maercker] 10 years ago
Dave Parker 9729c78b3e Inefficiency in precomputatino routines in explicit engine (spotted by Steffen Marcker). 11 years ago
Dave Parker a18d28a17b Refactor: use IterableStateSet to simplify loops [Joachim Klein]. 11 years ago
Dave Parker 5295b1a180 Bug fix in MDPSimple.mvMultJacSingle (from Joachim Klein). 11 years ago
Dave Parker 89fab7269a Bug fix in getSuccessorsIterator(s) in SubNondetModel (showed up as regression test failure in prism-games-heuristics-merge), plus required missing method getSuccessorsIterator(s,i) in NondetModel. 12 years ago
Dave Parker 4a29528714 Bug fix: missing state rewards in mvMultRewMinMaxSingleChoices methods (showed up on mdps/reach/mdp_simple.nm regression test). 12 years ago
Dave Parker 4d3d52edaf Policy iteration for reachability reward problems (explicit engine). 12 years ago
Dave Parker bb14cd09ab Add areAllChoiceActionsUnique() method to NondetModel. 13 years ago
Dave Parker ff11760860 Update strategy generation in explicit engine to distinguish between: -1 (unknown), -2 (arbitrary), -3 (unreachable). 13 years ago
Dave Parker b06df8c756 Fixes in strategy generation for expected rewards in explicit engine (should only check for strict changes in max case). 13 years ago
Dave Parker 1c42335bcf Some refactoring of explicit model classes, to introduce NondetModel interface. 13 years ago
Dave Parker 5a1186c177 Strategy synthesis for reach rewards in the explicit engine: choices for inf states and do export. 13 years ago
Dave Parker 65a6464b32 Strategy synthesis for reach rewards in the explicit engine (no precomputation yet). 13 years ago
Dave Parker 8b6d5d17a8 Improvements to strategy generation for MDP reachability in explicit engine, notably algorithms for precomputation. Also split Prob1 into Prob1A and Prob1E for efficiency reasons. 13 years ago
Dave Parker 51bf20f1f6 Add strategy generation to MDP Gauss-Seidel (explicit). 13 years ago
Dave Parker c02983ea26 Small code tidies. 13 years ago
Dave Parker 064356d11f Rename adversary to strategy in explicit MDP model checking + align with prism-games. 13 years ago
Dave Parker 018c8c89d5 Miscellaneous code changes/tidies - trying to align with prism-games a bit. 13 years ago
Dave Parker 99d2139f55 Add getSuccessorsIterator to explicit Model interface. 14 years ago
Dave Parker a218d09b2b * Continued major changes to PRISM API 14 years ago
Dave Parker a869bbeec0 Gauss-Seidel val iter for cumulative rewards in explicit engine. 14 years ago
Dave Parker 355032b5e3 Code tidy 15 years ago
Dave Parker 9ba97fe1fc Add MDPExplicit class to capture shared from MDPSimple/MDPSparse (also a few fixes to same thing done previously for DTMCs). 15 years ago
Dave Parker d54e92533c Another fix for adv gen in explicit engine: min probs should not be treated as for max probs. 15 years ago
Dave Parker e24ee33442 Bug fix in explicit MDPs: actions added as 0.0 instead of null. 15 years ago
Dave Parker 0bb97718c1 Adv gen for rewards in explicit engine (from prism-games). 15 years ago
Dave Parker f49ce60f1b Fixes in explicit MDP adversary generation (min case can give wrong answer). 15 years ago
Dave Parker bedfccb2ec Re-arrangement of explicit model classes: 15 years ago
Dave Parker 6be5202551 Slight tweak in MDP interface (to match STPG). 15 years ago
Dave Parker ea9463344b Update to (explicit) MDP interface. 15 years ago
Dave Parker 16a8c710ae More re-arranging of explicit rewards (from prism-qar). 15 years ago
Dave Parker 80b693fee8 Added state rewards into MDP model checking in explicit engine. 15 years ago
Dave Parker a539e72e57 MDPSimple bug fix (from prism-qar). 15 years ago
Dave Parker e5b7ad597e Expansion of transition-matrix-export functionality for explicit engine. 15 years ago
Dave Parker 25b8626a51 Code tidy. 15 years ago
Dave Parker 3403e8b417 Some bugfixes and adds in explicit MDP classes, mainly relating to action labels. 15 years ago
Dave Parker edab23b581 More updates to explicit library: 15 years ago
Dave Parker b8a78c4031 Updates to explicit engine from prism-qar (Vojta): 15 years ago
Dave Parker 24caab6c97 Credit/copyright for Christian von Essen. 15 years ago
Dave Parker e33c2b1301 Added action names to other MDP explicit exports (dot, PRISM lang). 15 years ago
Dave Parker ac4eac3719 Action names included in explicit MDP export to tra file (from prism-qar). 15 years ago
Dave Parker 85147f1a71 Explicit engine improvements, mainly MDP rewards: 15 years ago
Dave Parker 1a21d7f342 Explicit engine handles "deadlock" and "init" labels, if not embedded in a (logical) expression. 15 years ago
Dave Parker 52d2d21447 Update to newest version of explicit code (from prism-qar) plus -explicit switch for command-line and MDP solution settings. 15 years ago
Dave Parker 993b33264c Export to PRISM language from explicit models. 16 years ago