On the Development of Deep Convolutional Sum-Product Networks

dc.contributor.advisorButz, Cortney J.
dc.contributor.authorOliveira, Jhonatan de Souza
dc.contributor.committeememberSadaoui-Mouhoub, Samira
dc.contributor.committeememberZilles, Sandra
dc.contributor.committeememberFallat, Shaun
dc.contributor.externalexaminerCassio de Campos, Habil
dc.date.accessioned2020-08-26T22:25:37Z
dc.date.available2020-08-26T22:25:37Z
dc.date.issued2019-12
dc.descriptionA Thesis Submitted to the Faculty of Graduate Studies and Research In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Computer Science, University of Regina. xii, 143 p.en_US
dc.description.abstractA probabilistic graphical model (PGM) is a formal mathematical description of a problem domain. A Bayesian network (BN) is a PGM defined by a directed acyclic graph (DAG) and a set of conditional probability tables (CPTs). Two tasks can be employed when reasoning about a problem expressed as a BN: modeling and inference. In modeling, we want to express the problem domain as a DAG in which indepen- dencies among the variables involved can be read. There are two main algorithms for testing independencies from a BN DAG, namely, d-separation and m-separation. In this thesis, we begin by introducing Darwinian networks (DNs), which are, in some way, a clearer representation of a BN. By using DNs, we derived a new way of testing independencies in a BN, called rp-separation, which is a faster alternative to d-separation. Another practical application of DNs was simple propagation, which is the current state-of-the-art join tree inference algorithm in BNs. A sum-product network (SPN) is another type of PGM defined by a DAG and a set of parameters. An SPN permits tractable inference, while inference is generally NP-hard in BNs. Furthermore, SPNs can be compiled from BNs or learned from data. In this thesis, we first resolve the inconsistency between the SPN scope definition and the CPT label when compiling a BN into an SPN. Next, we empirically explore new methods for learning an SPN structure and parameters. Finally, we introduce deep convolutional sum-product networks (DCSPNs), which use a convolutional neural net- work to build a correct SPN. DCSPNs exploit the commonly used tensor libraries for neural networks, while still guaranteeing correctness as a PGM. Experimental results show that DCSPNs are comparable to state-of-the-art methods in image completion tasks.en_US
dc.description.authorstatusStudenten
dc.description.peerreviewyesen
dc.identifier.tcnumberTC-SRU-9177
dc.identifier.thesisurlhttps://ourspace.uregina.ca/bitstream/handle/10294/9177/Oliveira_Jhonatan_deSouza_PhD_CS_Spring2020.pdf
dc.identifier.urihttps://hdl.handle.net/10294/9177
dc.language.isoenen_US
dc.publisherFaculty of Graduate Studies and Research, University of Reginaen_US
dc.titleOn the Development of Deep Convolutional Sum-Product Networksen_US
dc.typeThesisen
thesis.degree.departmentDepartment of Computer Scienceen_US
thesis.degree.disciplineComputer Scienceen_US
thesis.degree.grantorUniversity of Reginaen
thesis.degree.levelDoctoralen
thesis.degree.nameDoctor of Philosophy (PhD)en_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Oliveira_Jhonatan_deSouza_PhD_CS_Spring2020.pdf
Size:
8.61 MB
Format:
Adobe Portable Document Format
Description:
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
2.22 KB
Format:
Item-specific license agreed upon to submission
Description: