Properties and Bayesian fitting of restricted Boltzmann machines

Simple item page
dc.contributor.author Kaplan, Andee
dc.contributor.author Nordman, Daniel
dc.contributor.author Vardeman, Stephen
dc.contributor.department Statistics
dc.contributor.department Industrial and Manufacturing Systems Engineering
dc.date 2020-02-28T18:29:01.000
dc.date.accessioned 2020-07-02T06:57:40Z
dc.date.available 2020-07-02T06:57:40Z
dc.date.copyright Mon Jan 01 00:00:00 UTC 2018
dc.date.embargo 2020-02-01
dc.date.issued 2019-02-01
dc.description.abstract <p>A restricted Boltzmann machine (RBM) is an undirected graphical model constructed for discrete or continuous random variables, with two layers, one hidden and one visible, and no conditional dependency within a layer. In recent years, RBMs have risen to prominence due to their connection to deep learning. By treating a hidden layer of one RBM as the visible layer in a second RBM, a deep architecture can be created. RBMs thereby are thought to have the ability to encode very complex and rich structures in data, making them attractive for supervised learning. However, the generative behavior of RBMs largely is unexplored and typical fitting methodology does not easily allow for uncertainty quantification in addition to point estimates. In this paper, we discuss the relationship between RBM parameter specification in the binary case and model properties such as degeneracy, instability and uninterpretability. We also describe the associated difficulties that can arise with likelihood‐based inference and further discuss the potential Bayes fitting of such (highly flexible) models, especially as Gibbs sampling (quasi‐Bayes) methods often are advocated for the RBM model structure.</p>
dc.description.comments <p>This is the peer-reviewed version of the following article: Kaplan, Andee, Daniel Nordman, and Stephen Vardeman. "Properties and Bayesian fitting of restricted Boltzmann machines." <em>Statistical Analysis and Data Mining: The ASA Data Science Journal</em> 12, no. 1 (2019): 23-38, which has been published in final form at DOI: <a href="http://dx.doi.org/10.1002/sam.11396" target="_blank">10.1002/sam.11396</a>. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.</p>
dc.format.mimetype application/pdf
dc.identifier archive/lib.dr.iastate.edu/stat_las_pubs/288/
dc.identifier.articleid 1290
dc.identifier.contextkey 15787868
dc.identifier.s3bucket isulib-bepress-aws-west
dc.identifier.submissionpath stat_las_pubs/288
dc.identifier.uri https://dr.lib.iastate.edu/handle/20.500.12876/90607
dc.language.iso en
dc.source.bitstream archive/lib.dr.iastate.edu/stat_las_pubs/288/2019_VardemanStephen_PropertiesBayesian.pdf|||Fri Jan 14 23:12:07 UTC 2022
dc.source.uri https://lib.dr.iastate.edu/cgi/viewcontent.cgi?article=1132&context=stat_las_preprints
dc.subject.disciplines Probability
dc.subject.disciplines Statistical Models
dc.subject.disciplines Statistics and Probability
dc.subject.keywords Degeneracy
dc.subject.keywords Instability
dc.subject.keywords Classification
dc.subject.keywords Deep Learning
dc.subject.keywords Graphical Models
dc.title Properties and Bayesian fitting of restricted Boltzmann machines
dc.type article
dc.type.genre article
dspace.entity.type Publication
relation.isOrgUnitOfPublication 264904d9-9e66-4169-8e11-034e537ddbca
relation.isOrgUnitOfPublication 51d8b1a0-5b93-4ee8-990a-a0e04d3501b1
File
Original bundle
Now showing 1 - 1 of 1
Name:
2019_VardemanStephen_PropertiesBayesian.pdf
Size:
1.06 MB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Publications