Dhaka University Journal of Applied Science & Engineering

• Md Samiullah
  Department of Computer Science and Engineering, University of Dhaka, Dhaka
• David Albrecht
  Department of Digital Technologies, John Monash Science School
• Ann E Nicholson
  Faculty of IT, Monash University, Malaysia
• Chowdhury Farhan Ahmed
  Department of Computer Science and Engineering, University of Dhaka, Dhaka

Our daily life is full of challenges, and the biggest challenge is the unpredictability of many of our significant life events. To deal with this unpredictability, analysing the probability of events has become very important. In particular, the theorem of English statistician Thomas Bayes has been revolutionary. Numerous theories and techniques have been proposed, and many tools have been developed to solve real-life problems based on the theorem, yet it is still very much an area of active research. It still attracts researchers dealing with cutting-edge technologies. One tool that has been used extensively in modelling probabilistic analysis for decades is the Probabilistic Graphical Model (PGM). PGMs have very challenging childhood but glorious youth. The vast applicability of the models in cutting-edge technologies attracts researchers, modellers and scientists of diversified fields. Hence there are numerous models with their respective features, merits and backlogs. To date, there have been very few surveys conducted among the wide range of models and their associated tools. More specifically, those few reviews are highly application and domain focused, and limited to three to four very popular and widely used models and their associated learning and inference algorithms. To the best of our knowledge, this paper is the first that presents the features, limitations, design and implementation platforms, research challenges and applicability of the models based on a common framework that consists of some essential attributes of the popular PGMs and tools for probabilistic analysis. The study helps deciding an appropriate tool as per the perspective of the application and feature of the tool. This paper concludes with future research scope and a non-exhaustive list of applications of PGMs.

1. E. Charniak, “Bayesian networks without tears”,AI Magazine, vol. 12, no. 4, pp. 50–50, 1991.
2. D. Nikovski, “Constructing Bayesian networks for medical diagnosis from incomplete and partially correct statistics,” IEEE Transactions on Knowledge and Data Engineering, vol. 12, no. 4, pp. 509–516, 2000.
3. J. Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference. Elsevier, 2014.
4. J. Pearl, “Causality: models, reasoning and inference,” Econometric Theory, vol. 19, no. 675685, p. 46, 2003.
5. J. Pearle, Probabilistic reasoning in intelligent systems.Morgan kaufmann, 1988.
6. F. V. Jensen and T. D. Nielsen, Bayesian Networks and Decision Graphs. (2nd ed.), New York, Springer Verlag, 2007.
7. T. Charitos, L. van der Gaag, S. Visscher, K. Schurink, and P. Lucas, “A dynamic Bayesian network for diagnosing ventilator-associated pneumonia in ICU patients,” Expert Systems with Applications, vol. 36, no. 2, pp. 1249–258, 2009.
8. C. Conati, A. Gertner, K. VanLehn, and M. Druzdzel, “On-Line Student Modeling for Coached Problem Solving Using Bayesian Networks,” Proc. of the 6th Int’l Conf. on User Modeling, pp. 231–242, 1997.
9. K. Kristensen and I. Rasmussen, “The use of a Bayesian network in the design of a decision support system for growing malting barley without use of pesticides,” Computers and Electronics in Agriculture, vol. 33, no. 3, pp. 197–217, 2002.
10. P. A. Aguilera, A. Fernández, R. Fernández, R. Rumí, and A. Salmerón, “Bayesian Networks in Environmental Modelling,” Environmental Modelling & Software, vol. 26, no. 12, pp. 1376–1388, 2011.
11. R. Baker, A. Battisti, J. Bremmer, M. Kenis, J. Mumford, F. Petter, G. Schrader, S. Bacher, P. DeBarro, P. Hulme, O. Karadjova, A. Lansink, O. Pruvost, P. Pysek, A. Roques, Y. Baranchikov, and J.-H. Sun, “ PRATIQUE: a research project to enhance pest risk analysis techniques in the European Union,” EPPO Bulletin, vol. 39, no. 1, pp. 87–93, 2009.
12. S. Mascaro, K. Korb, and A. Nicholson, “Anomaly Detection in Vessel Tracks using Bayesian Networks.” Int’l Journal of Approximate Reasoning, Elsevier Science, vol. 55, no. 1, pp. 84–96, 2011.
13. L. Falzon, “Using Bayesian network analysis to support centre of gravity analysis in military planning,” European Journal of Operational Research, vol. 170, no. 2, pp. 629–643, 2006.
14. T. Boneh, G. Weymouth, P. Newham, R. Potts, J. Bally, A. Nicholson, and K. Korb, “Fog forecasting for Melbourne Airport using a Bayesian network.” Weather and Forecasting, vol. 30, no. 5, pp. 1218–1233, 2015.
15. A. Tang, A. Nicholson, Y. Jin, and J. Han, “Using Bayesian belief networks for change impact analysis in architecture design,” Journal of Systems and Software, vol. 80, no. 1, pp. 127–148, 2007.
16. M. Horny, “Bayesian networks,” School of Public Health, Department of Health Policy and Management, Boston University, Tech. Rep. 5, 2014
17. T. Boneh, “Ontology and Bayesian Decision Networks for Supporting the Meteorological Forecasting Process,” Ph.D. dissertation, Clayton School of Information Technology, Monash University, 2010.
18. D. Koller and A. Pfeffer, “Object-Oriented Bayesian Networks,” Proc. of the 13th Conf. on Uncertainty in Artificial Intelligence (UAI), USA, pp. 302–313, 1997
19. O. Bangsø, M. J. Flores, and F. V. Jensen, “Plug & Play Object Oriented Bayesian Networks,”Proc. Of the 10th Conf. of the Spanish Association for Artificial Intelligence, CAEPIA 2003, pp. 457–467, 2003.
20. C. Meek and D. Heckerman, “Structure and Parameter Learning for Causal Independence and Causal Interaction Models,” Proc. of the 13th Conf. onUncertainty in Artificial Intelligence (UAI), USA, pp. 366–375, 1997
21. K. B. Laskey and S. M. Mahoney, “Network Fragments: Representing Knowledge for Constructing Probabilistic Models,” Proc. of the 13th Conf. on Uncertainty in Artificial Intelligence (UAI), USA, pp. 334–341, 1997.
22. D. Heckerman, C. Meek, and D. Koller, “Probabilistic entity-relationship models, PRMs, and plate models,” Proc. ofIntroduction to statistical relational learning, pp. 201–238, 2007.
23. K. B. Laskey, “MEBN: A language for first-order Bayesian knowledge bases,” Artif. Intell., vol. 172, no. 2-3, pp. 140–178, 2008
24. D. P. Xiang Yang and M. P. Beddoes., “Multiply Sectioned Bayesian Networks and Junction Forests for Large Knowledge-Based Systems,” Computational Intelligence, vol. 9, no. 2, pp. 171–220, 1993.
25. N. Fenton and M. Neil, “Building large-scale Bayesian networks,” The Knowledge Engineering Review, vol. 15, no. 3, pp. 257–284, 2000.
26. D. Koller and N. Friedman, Probabilistic Graphical Models - Principles and Techniques. MIT Press, 2009
27. V. J. Easton and J. H. McColl. Statistics Glossary, 1997. [Online; accessed 15-July-2019]. [Online]. Available: http://www.stats.gla.ac.uk/steps/glossary/
28. B. J. Frey, andN. Jojic,“A comparison of algorithms for inference and learning in probabilistic graphical models”,IEEE Transactions on pattern analysis and machine intelligence, Vol. 27, No. 9, pp. 1392-1416, 2005.
29. P. Larrañaga,andS. Moral, “Probabilistic Graphical Models in Artificial Intelligence”,Applied Soft Computing, Vol. 11, No. 2, pp. 1511-1528, 2011.
30. P. Larrañaga,H. Karshenas,C. Bielza, andR. Santana,“A review on probabilistic graphical models in evolutionary computation”,Journal of Heuristics, Vol. 18, No. 5, pp. 795-819, 2012.
31. L. Hongmei, H. Wenning, G. Wenyan, andC. Gang,“Survey of probabilistic graphical models”,Proc. of the 10thWeb Information System and Application Conference, pp. 275-280, 2013.
32. W. L. Buntine, “Operations for Learning with Graphical Models,” CoRR, vol. abs/1105.2519, 2011. [Online]. Available: http://arxiv.org/abs/1105.2519
33. R. G. Cowell, A. P. Dawid, and D. J. Spiegelhalter, “Sequential Model Criticism in Probabilistic ExpertSystems,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 3, pp. 209–219, 1993.
34. D. Koller, “Probabilistic Relational Models,” Proc. ofInt’l Conf. on Inductive Logic Programming, Springer, pp. 3–13, 1999.
35. M. B. Ishak, “Probabilistic relational models: learning and evaluation. (Les modèles probabilistes relationnels : apprentissage et évaluation),” Ph.D. dissertation, University of Nantes, France, 2015. [Online]. Available: https://tel.archives-ouvertes. fr/tel-01179501
36. M. Cossalter, O. Mengshoel, and T. Selker, “Visualizing and understanding large-scale Bayesian networks,” in Workshops at the 25thAAAI Conference on Artificial Intelligence, 2011.
37. M. Horny, “Bayesian networks,” School of Public Health, Department of Health Policy and Management, Boston University, Tech. Rep. 5, 4 2014
38. S. Psillos, “An Explorer upon Untrodden Ground: Peirce on Abduction”,Handbook of the History of Logic, Vol. 10, pp. 117-151,2011
39. K. B. Korb and A. E. Nicholson, Bayesian Artificial Intelligence. CRC Press, 2010.
40. P. Dagum, A. Galper, and E. Horvitz, “Dynamic network models for forecasting,” Uncertainty in Artificial Intelligence. Elsevier, pp. 41–48, 1992.
41. A. E. Nicholson, “Monitoring discrete environments using dynamic belief networks (robotics),” Ph.D. dissertation, PhD thesis, University of Oxford (United Kingdom), 1992.
42. U. Kjærulff, “A computational scheme for dynamic Bayesian networks,” 1993.
43. T. L. Dean and K. Kanazawa, “Probabilistic Temporal Reasoning.” in AAAI, pp. 524–529, 1988.
44. D. Koller and A. Pfeffer, “Object-oriented Bayesian networks,”Proc. of the 13thconf. on Uncertainty in Artificial Intelligence. Morgan Kaufmann, pp. 302–313, 1997.
45. L. Torti, P.-H. Wuillemin, and C. Gonzales, “Reinforcing the Object-Oriented aspect of probabilistic relational models,” Proc. of European Workshop on Probabilistic Graphical Models, pp. 273–280, 2010.
46. D. Koller, “Probabilistic Relational Models,” Proc. ofInductive Logic Programming, 9thInternational Workshop, pp. 3–13, 1999
47. L. Getoor, N. Friedman, D. Koller, A. Pfeffer, and B. Taskar, “Probabilistic relational models”, Introduction to statistical relational learning, vol. 8, 2007
48. J. Neville and D. D. Jensen, “Dependency Networks for Relational Data,”Proc. of the 4th IEEE International Conference on Data Mining (ICDM 2004), pp. 170–177, 2004.
49. M. Jaeger, “Relational Bayesian Networks,” Proc. of the 13th Conference on Uncertainty in Artificial Intelligence, USA, 1997, pp. 266–273.
50. M. Grzegorczyk, “An introduction to Gaussian Bayesian networks,” Systems Biology in Drug Discovery and Development, Springer, pp. 121–147, 2010.
51. BayesFusion.com. GeNIe Modeler: Complete Modeling Freedom, 2018. [Online; accessed 19-February-2019]. [Online]. Available: https://www.bay esfusion.com/genie/
52. C. Gonzales, L. Torti, M. Chopin, and P.-H. Wuillemin, “aGrUM: A GRaphical Universal Modeler,” https://forge.lip6.fr/projects/agrum, [Online; accessed 27-June-2017].
53. M. Samiullah, iOOBN: An Object-Oriented Bayesian Network Modelling Framework with Inheritance. Doctoral dissertation, Monash University, 2020.
54. J. Pearl andT. S. Verma, “A statistical semantics for causation”,Statistics and Computing, Vol. 2, No. 2, pp. 91-95, 1992.
55. R. T. O’Donnell,A. E. Nicholson, B. Han, K.B. Korb, M.J. Alam and L. R. Hope,“Causal discovery with prior information”,Proc. Australasian Joint Conference on Artificial Intelligence, Springer, Berlin, Heidelberg, pp. 1162-1167, 2006.
56. P.Larrañaga, H. Karshenas, C. Bielza andR. Santana, “A review on probabilistic graphical models in evolutionary computation”,Journal of Heuristics, 18(5), 795-819, 2012.
57. E. M.Airoldi,“Getting started in probabilistic graphical models”,PLoS Comput Biol, 3(12), e252, 2007.
58. T. A. Jilani, and S. A. R. Naqvi,“A review of probabilistic graph models for feature selection with applications in Economic and Financial time series forecasting VFAST”, Transactions on Software Engineering, 2(1), 21-28, 2014.