ISSN:
1435-568X
Schlagwort(e):
Key words. Recurrent neural networks, Folding networks, Computational learning theory, PAC learning, VC dimension.
Quelle:
Springer Online Journal Archives 1860-2000
Thema:
Elektrotechnik, Elektronik, Nachrichtentechnik
,
Mathematik
,
Technik allgemein
Notizen:
Abstract. We establish some general results concerning PAC learning: We find a characterization of the property that any consistent algorithm is PAC. It is shown that the shrinking width property is equivalent to PUAC learnability. By counterexample, PAC and PUAC learning are shown to be different concepts. We find conditions ensuring that any nearly consistent algorithm is PAC or PUAC, respectively.¶The VC dimension of recurrent neural networks and folding networks is infinite. For restricted inputs, however, bounds exist. The bounds for restricted inputs are transferred to folding networks.¶We find conditions on the probability of the input space ensuring polynomial learnability: the probability of sequences or trees has to converge to zero sufficiently fast with increasing length or height.¶Finally, we find an example for a concept class that requires exponentially growing sample sizes for accurate generalization.
Materialart:
Digitale Medien
URL:
http://dx.doi.org/10.1007/PL00009845
Permalink
