https://sourceforge.net/p/triceps/activity/Recent activity for TricepsenSun, 01 Jun 2025 17:36:07 -0000https://sourceforge.net/p/triceps/code/1825/Added the fast brake factor, to adjust the amount of braking.Sergey BabkinSun, 01 Jun 2025 17:36:07 -0000https://sourceforge.net/p/triceps/code/1825/https://sourceforge.net/p/triceps/code/1824/Fixed a diagnostics that got broken in refactoring.Sergey BabkinSun, 01 Jun 2025 08:08:56 -0000https://sourceforge.net/p/triceps/code/1824/https://sourceforge.net/p/triceps/code/1823/Added support for combining momentum with stochastic descent.Sergey BabkinSun, 01 Jun 2025 08:01:56 -0000https://sourceforge.net/p/triceps/code/1823/https://sourceforge.net/p/triceps/code/1822/Updated the naming: the last-pass weights were actually pre-last-pass weights.Sergey BabkinSun, 01 Jun 2025 06:39:30 -0000https://sourceforge.net/p/triceps/code/1822/https://sourceforge.net/p/triceps/code/1821/Merged the main and corner weights in autorate computation (this shouldSergey BabkinSun, 01 Jun 2025 06:20:36 -0000https://sourceforge.net/p/triceps/code/1821/https://sourceforge.net/p/triceps/code/1820/Fixed the miscompitation level sizes, added a test.Sergey BabkinSun, 01 Jun 2025 04:48:00 -0000https://sourceforge.net/p/triceps/code/1820/https://sourceforge.net/p/triceps/code/1819/Merged the main weights and corner weights into a single interleaved vector.Sergey BabkinSat, 31 May 2025 21:02:31 -0000https://sourceforge.net/p/triceps/code/1819/https://sourceforge.net/p/triceps/code/1818/Weights are now always accessed through the high-level way.Sergey BabkinSat, 31 May 2025 19:38:39 -0000https://sourceforge.net/p/triceps/code/1818/https://sourceforge.net/p/triceps/code/1817/A minor clean-up.Sergey BabkinSat, 31 May 2025 19:28:13 -0000https://sourceforge.net/p/triceps/code/1817/https://sourceforge.net/p/triceps/code/1816/Made FloatNeuralNet::setLevel() and getLevel() use higher-level primitives.Sergey BabkinSat, 31 May 2025 19:18:43 -0000https://sourceforge.net/p/triceps/code/1816/https://sourceforge.net/p/triceps/code/1815/Made FloatNeuralNet::randomize() use the high-level representation of weights.Sergey BabkinSat, 31 May 2025 18:55:25 -0000https://sourceforge.net/p/triceps/code/1815/https://sourceforge.net/p/triceps/code/1814/Changed the demos to return a stable result, so that it can beSergey BabkinSat, 31 May 2025 18:07:59 -0000https://sourceforge.net/p/triceps/code/1814/https://sourceforge.net/p/triceps/code/1813/A minor clean-up of expression.Sergey BabkinSat, 31 May 2025 18:02:56 -0000https://sourceforge.net/p/triceps/code/1813/https://sourceforge.net/p/triceps/code/1812/Converted the main cae to use the Tweaker and updateVectorGradient().Sergey BabkinSun, 25 May 2025 08:15:55 -0000https://sourceforge.net/p/triceps/code/1812/https://sourceforge.net/p/triceps/code/1811/Encapsulated tweaker in a structure, used it in updateVectorGradient().Sergey BabkinSat, 24 May 2025 19:15:39 -0000https://sourceforge.net/p/triceps/code/1811/https://sourceforge.net/p/triceps/code/1810/Generalized the update of FNN weights, so far only in by-level computation.Sergey BabkinSun, 18 May 2025 07:41:15 -0000https://sourceforge.net/p/triceps/code/1810/https://sourceforge.net/p/triceps/code/1809/The code used to build the graphs in the realSEUDO paperSergey BabkinThu, 16 Jan 2025 09:26:13 -0000https://sourceforge.net/p/triceps/code/1809/https://sourceforge.net/p/triceps/code/1808/Converted the preiously-ifdefed code for fast brake and fixed nu into FNN options.Sergey BabkinWed, 24 May 2023 07:57:43 -0000https://sourceforge.net/p/triceps/code/1808/https://sourceforge.net/p/triceps/code/1807/Use exception references in XS code.Sergey BabkinSun, 21 May 2023 17:29:42 -0000https://sourceforge.net/p/triceps/code/1807/https://sourceforge.net/p/triceps/code/1806/Docs for the Matlab build.Sergey BabkinTue, 09 May 2023 06:46:15 -0000https://sourceforge.net/p/triceps/code/1806/https://sourceforge.net/p/triceps/code/1805/Added the Matlab-specific buildSergey BabkinTue, 09 May 2023 06:30:51 -0000https://sourceforge.net/p/triceps/code/1805/https://sourceforge.net/p/triceps/code/1804/Fixed the build for GCC 11.3.Sergey BabkinTue, 09 May 2023 05:11:40 -0000https://sourceforge.net/p/triceps/code/1804/https://sourceforge.net/p/triceps/code/1803/Added the FloatNeuralNet experiments in slow start and arrested bouncing.Sergey BabkinSat, 18 Feb 2023 23:53:42 -0000https://sourceforge.net/p/triceps/code/1803/https://sourceforge.net/p/triceps/code/1802/More MNIST & FloatNeuralNet experiments:Sergey BabkinSun, 15 Jan 2023 03:32:15 -0000https://sourceforge.net/p/triceps/code/1802/https://sourceforge.net/p/triceps/code/1801/For MNIST demo, added a trapeze mode with absolute X coordinates instead of relative widths (and it works even worse).Sergey BabkinWed, 11 Jan 2023 06:42:05 -0000https://sourceforge.net/p/triceps/code/1801/https://sourceforge.net/p/triceps/code/1800/In FloatNeuralNet autoRate2_. made the rate bumps up higher and bumps down lower to bring them closer together.Sergey BabkinSun, 08 Jan 2023 16:11:45 -0000https://sourceforge.net/p/triceps/code/1800/https://sourceforge.net/p/triceps/code/1799/In FloatNeuralNet removed the reference to mdiff_* when momentum is disabled.Sergey BabkinSun, 08 Jan 2023 16:00:30 -0000https://sourceforge.net/p/triceps/code/1799/https://sourceforge.net/p/triceps/code/1798/Fixed getting the first gradient in FloatNeuralNet.Sergey BabkinSun, 08 Jan 2023 15:32:38 -0000https://sourceforge.net/p/triceps/code/1798/https://sourceforge.net/p/triceps/code/1797/Experiments with alternative encodings of MNIST input: via run-length and trapezes.Sergey BabkinSun, 08 Jan 2023 15:22:47 -0000https://sourceforge.net/p/triceps/code/1797/https://sourceforge.net/p/triceps/code/1796/Added rul-length encoding for the MNIST ZIP example.Sergey BabkinSat, 07 Jan 2023 06:57:46 -0000https://sourceforge.net/p/triceps/code/1796/https://sourceforge.net/p/triceps/code/1795/Even more aggressive settings in FNN autoRate2, and debug printout of gradientSergey BabkinSat, 07 Jan 2023 06:57:18 -0000https://sourceforge.net/p/triceps/code/1795/https://sourceforge.net/p/triceps/code/1794/More examples of FloatNeuralNet with a high-ish tweak rate.Sergey BabkinThu, 05 Jan 2023 05:05:51 -0000https://sourceforge.net/p/triceps/code/1794/https://sourceforge.net/p/triceps/code/1793/More experimentation with autoRate2 in FloatNeuralNet, adjusting the conditions,Sergey BabkinWed, 04 Jan 2023 09:46:10 -0000https://sourceforge.net/p/triceps/code/1793/https://sourceforge.net/p/triceps/code/1792/In FloatNeuralNet added the stop of momentum on the dimensions that change gradient sign,Sergey BabkinMon, 02 Jan 2023 12:07:52 -0000https://sourceforge.net/p/triceps/code/1792/https://sourceforge.net/p/triceps/code/1791/Add a small deterministic but unequal tweak to the gradients in FloatNeuralNet,Sergey BabkinMon, 02 Jan 2023 08:39:28 -0000https://sourceforge.net/p/triceps/code/1791/https://sourceforge.net/p/triceps/code/1790/Changed the implementation of boosting the rare cases in FloatNeuralNet classifiers:Sergey BabkinMon, 02 Jan 2023 02:05:15 -0000https://sourceforge.net/p/triceps/code/1790/https://sourceforge.net/p/triceps/code/1789/A MNIST version with 16x16 input and 256 first-layer neurons.Sergey BabkinSat, 31 Dec 2022 03:40:23 -0000https://sourceforge.net/p/triceps/code/1789/https://sourceforge.net/p/triceps/code/1788/In MNIST, added an explicit label field to training data and added commented-outSergey BabkinTue, 27 Dec 2022 02:04:03 -0000https://sourceforge.net/p/triceps/code/1788/https://sourceforge.net/p/triceps/code/1787/Tried including the MNIST test vector into training vector, this makes it recognized very well.Sergey BabkinTue, 27 Dec 2022 00:21:40 -0000https://sourceforge.net/p/triceps/code/1787/https://sourceforge.net/p/triceps/code/1786/Measurements of MNIST example with momentum descent.Sergey BabkinThu, 22 Dec 2022 10:45:28 -0000https://sourceforge.net/p/triceps/code/1786/https://sourceforge.net/p/triceps/code/1785/An optimization of FloatNeuralNet: skip the computation of new weights in train()Sergey BabkinThu, 22 Dec 2022 09:22:40 -0000https://sourceforge.net/p/triceps/code/1785/https://sourceforge.net/p/triceps/code/1784/Added the momentum mode to FloatNeuralNet.Sergey BabkinThu, 22 Dec 2022 09:13:24 -0000https://sourceforge.net/p/triceps/code/1784/https://sourceforge.net/p/triceps/code/1783/Added FNN pull-up for training cases where the output is correct but its value is still below 0.Sergey BabkinThu, 22 Dec 2022 06:02:01 -0000https://sourceforge.net/p/triceps/code/1783/https://sourceforge.net/p/triceps/code/1782/Fixed a -Wall compilation failure.Sergey BabkinWed, 21 Dec 2022 05:02:09 -0000https://sourceforge.net/p/triceps/code/1782/https://sourceforge.net/p/triceps/code/1781/Added (conditionally compiled) the printout of misrecognized characters in MNIST.Sergey BabkinWed, 21 Dec 2022 04:58:21 -0000https://sourceforge.net/p/triceps/code/1781/https://sourceforge.net/p/triceps/code/1780/Bumped the correctMultiplier_ FNN option to 0.01.Sergey BabkinTue, 20 Dec 2022 16:23:10 -0000https://sourceforge.net/p/triceps/code/1780/https://sourceforge.net/p/triceps/code/1779/Added to FloatNeuralNet an option for classifier training that gives preferenceSergey BabkinTue, 20 Dec 2022 14:54:47 -0000https://sourceforge.net/p/triceps/code/1779/https://sourceforge.net/p/triceps/code/1778/Added batching to the MIST example. It didn't work well at all.Sergey BabkinMon, 19 Dec 2022 08:10:31 -0000https://sourceforge.net/p/triceps/code/1778/https://sourceforge.net/p/triceps/code/1777/More recorded experinments of MNIST NN training.Sergey BabkinMon, 19 Dec 2022 03:30:05 -0000https://sourceforge.net/p/triceps/code/1777/https://sourceforge.net/p/triceps/code/1776/Added priniting of error rate on training data every 10th time for Zipcode NN example.Sergey BabkinSun, 18 Dec 2022 12:33:05 -0000https://sourceforge.net/p/triceps/code/1776/https://sourceforge.net/p/triceps/code/1775/More experiments with Zipcode NN, added checkpointing to it.Sergey BabkinSun, 18 Dec 2022 12:19:41 -0000https://sourceforge.net/p/triceps/code/1775/https://sourceforge.net/p/triceps/code/1774/Added the counting of training passes and checkpointing in FNN.Sergey BabkinSun, 18 Dec 2022 11:58:52 -0000https://sourceforge.net/p/triceps/code/1774/https://sourceforge.net/p/triceps/code/1773/Fixed the training rate setting in FloatNN autoRate. In the zip code recognition demoSergey BabkinSat, 17 Dec 2022 10:02:16 -0000https://sourceforge.net/p/triceps/code/1773/https://sourceforge.net/p/triceps/code/1772/Added a demo of MNIST handwriting recognition.Sergey BabkinWed, 14 Dec 2022 13:58:32 -0000https://sourceforge.net/p/triceps/code/1772/https://sourceforge.net/p/triceps/code/1771/Fixed a memory allocation error that showed with RELU, print the auto-rate value with %g because %f runs out of precision.Sergey BabkinWed, 14 Dec 2022 13:16:25 -0000https://sourceforge.net/p/triceps/code/1771/https://sourceforge.net/p/triceps/code/1770/Added FNN option enableWeightFloor_ and friends.Sergey BabkinSun, 27 Nov 2022 03:27:24 -0000https://sourceforge.net/p/triceps/code/1770/https://sourceforge.net/p/triceps/code/1769/In FNN: added option trainingRateScale_, option scaleRatePerLayer_,Sergey BabkinSun, 27 Nov 2022 02:11:23 -0000https://sourceforge.net/p/triceps/code/1769/https://sourceforge.net/p/triceps/code/1768/Improved the FNN test logging: print the stats on a redo pass, print the correct differenceSergey BabkinSat, 26 Nov 2022 22:14:40 -0000https://sourceforge.net/p/triceps/code/1768/https://sourceforge.net/p/triceps/code/1767/In FNN auto-rate, limited the number of redoings to one in a row, and added a lowerSergey BabkinFri, 25 Nov 2022 18:10:32 -0000https://sourceforge.net/p/triceps/code/1767/https://sourceforge.net/p/triceps/code/1766/The FloatNeuralNet auto-rate seems to work more or less, at least not dissolving into NaNs,Sergey BabkinFri, 25 Nov 2022 10:32:54 -0000https://sourceforge.net/p/triceps/code/1766/https://sourceforge.net/p/triceps/code/1765/More experimentation with FloatNeuralNet option autoRate_ shows that it'sSergey BabkinFri, 25 Nov 2022 08:27:51 -0000https://sourceforge.net/p/triceps/code/1765/https://sourceforge.net/p/triceps/code/1764/The FloatNeuralNet option autoRate_ is in place but not tested yet.Sergey BabkinMon, 07 Nov 2022 07:07:28 -0000https://sourceforge.net/p/triceps/code/1764/https://sourceforge.net/p/triceps/code/1763/Renamed FloatNeuralNet options to be consistent with Triceps style.Sergey BabkinSun, 06 Nov 2022 09:15:12 -0000https://sourceforge.net/p/triceps/code/1763/https://sourceforge.net/p/triceps/code/1762/When computing the gradient for adjsting the breaking point of the CORNERSergey BabkinSat, 05 Nov 2022 18:01:47 -0000https://sourceforge.net/p/triceps/code/1762/https://sourceforge.net/p/triceps/code/1761/Added a demo of XOR implemented with CORNER activation function in one neuron.Sergey BabkinSat, 05 Nov 2022 16:38:48 -0000https://sourceforge.net/p/triceps/code/1761/https://sourceforge.net/p/triceps/code/1760/Added to svn a forgotten header file.Sergey BabkinFri, 04 Nov 2022 09:03:09 -0000https://sourceforge.net/p/triceps/code/1760/https://sourceforge.net/p/triceps/code/1759/More experiments in mixing FloatNeuralNet activation functions.Sergey BabkinThu, 03 Nov 2022 07:42:14 -0000https://sourceforge.net/p/triceps/code/1759/https://sourceforge.net/p/triceps/code/1758/A couple of experiments with FloatNeuralNet:Sergey BabkinThu, 03 Nov 2022 07:10:37 -0000https://sourceforge.net/p/triceps/code/1758/https://sourceforge.net/p/triceps/code/1757/Added the full build dependency for mktest and mkdemo.Sergey BabkinThu, 03 Nov 2022 03:22:54 -0000https://sourceforge.net/p/triceps/code/1757/https://sourceforge.net/p/triceps/code/1756/Added options to FloatNeuralNet constructor.Sergey BabkinThu, 03 Nov 2022 03:14:13 -0000https://sourceforge.net/p/triceps/code/1756/https://sourceforge.net/p/triceps/code/1755/Added the demo targets at the top level.Sergey BabkinThu, 03 Nov 2022 02:50:06 -0000https://sourceforge.net/p/triceps/code/1755/https://sourceforge.net/p/triceps/code/1754/Split off the larger examples to be "demos" rather than "tests", because theySergey BabkinThu, 03 Nov 2022 02:29:08 -0000https://sourceforge.net/p/triceps/code/1754/https://sourceforge.net/p/triceps/code/1753/Early work on adding an on-disk store.Sergey BabkinThu, 03 Nov 2022 02:27:23 -0000https://sourceforge.net/p/triceps/code/1753/https://sourceforge.net/p/triceps/code/1752/Put back the default limitation of weights as +-1 in FloatNeuralNet,Sergey BabkinThu, 03 Nov 2022 02:04:23 -0000https://sourceforge.net/p/triceps/code/1752/https://sourceforge.net/p/triceps/code/1751/A better way to pull the breaking point of CORNER activation function sideways.Sergey BabkinSun, 23 Oct 2022 18:28:07 -0000https://sourceforge.net/p/triceps/code/1751/https://sourceforge.net/p/triceps/code/1750/The CORNER activation function sort of works empyrically, and shows a useful direction, but needs more thinking to get it more right.Sergey BabkinSun, 23 Oct 2022 05:08:04 -0000https://sourceforge.net/p/triceps/code/1750/https://sourceforge.net/p/triceps/code/1749/Fixed the bug in backpropagation of CORNER activation function, but now it started producing a straight line.Sergey BabkinSat, 22 Oct 2022 23:17:58 -0000https://sourceforge.net/p/triceps/code/1749/https://sourceforge.net/p/triceps/code/1748/The CORNER activation function basically works, but not with applyGradient() yet.Sergey BabkinSat, 22 Oct 2022 22:58:13 -0000https://sourceforge.net/p/triceps/code/1748/https://sourceforge.net/p/triceps/code/1747/Reogranized where the activation function derivatives get applied, madeSergey BabkinSat, 22 Oct 2022 21:48:59 -0000https://sourceforge.net/p/triceps/code/1747/https://sourceforge.net/p/triceps/code/1746/Started adding state for the CORNER activation function in FloatNeuralNet.Sergey BabkinSat, 22 Oct 2022 19:49:50 -0000https://sourceforge.net/p/triceps/code/1746/https://sourceforge.net/p/triceps/code/1745/Added a test for LEAKY_RELU with a random seed. It does get stuck as badly as basic RELU without reclaiming.Sergey BabkinSat, 22 Oct 2022 18:57:42 -0000https://sourceforge.net/p/triceps/code/1745/https://sourceforge.net/p/triceps/code/1744/Reuse the helper function throughout tests in t_FloatNeuralNetSergey BabkinSat, 22 Oct 2022 18:41:44 -0000https://sourceforge.net/p/triceps/code/1744/https://sourceforge.net/p/triceps/code/1743/Extracted the t_FloatNeuralNet typical training and printing segments into functions.Sergey BabkinSat, 22 Oct 2022 18:16:59 -0000https://sourceforge.net/p/triceps/code/1743/https://sourceforge.net/p/triceps/code/1742/Don't try to return a negative value in size_t in FloatNeuralNet::reclaim().Sergey BabkinSat, 22 Oct 2022 17:17:06 -0000https://sourceforge.net/p/triceps/code/1742/https://sourceforge.net/p/triceps/code/1741/In FloatNeuralNet removed the counting uf last level's usage, and implemented LEAKY_RELU activation function.Sergey BabkinSat, 22 Oct 2022 17:07:48 -0000https://sourceforge.net/p/triceps/code/1741/https://sourceforge.net/p/triceps/code/1740/Made the weigth saturation limit in FloatNeuralNet adjustable.Sergey BabkinSat, 22 Oct 2022 15:59:42 -0000https://sourceforge.net/p/triceps/code/1740/https://sourceforge.net/p/triceps/code/1739/Removed FloatNeuralNet::trainOld().Sergey BabkinSat, 22 Oct 2022 15:33:15 -0000https://sourceforge.net/p/triceps/code/1739/https://sourceforge.net/p/triceps/code/1738/Collect the neuron usage statistics only for RELU activation function.Sergey BabkinSat, 22 Oct 2022 15:31:49 -0000https://sourceforge.net/p/triceps/code/1738/https://sourceforge.net/p/triceps/code/1737/Made the last level in FloatNeuralNet pseudo-activated by copying the inactivated values.Sergey BabkinSat, 22 Oct 2022 15:00:02 -0000https://sourceforge.net/p/triceps/code/1737/https://sourceforge.net/p/triceps/code/1736/Extracted backpropagation by one level into FloatNeuralNet::backpropLevel().Sergey BabkinSat, 22 Oct 2022 13:19:31 -0000https://sourceforge.net/p/triceps/code/1736/https://sourceforge.net/p/triceps/code/1735/More experimentation with tests on random seeds in FloatNeuralNet. Used and documented a mixed way of applying gradients, both by case and cumulative.Sergey BabkinWed, 19 Oct 2022 10:58:08 -0000https://sourceforge.net/p/triceps/code/1735/https://sourceforge.net/p/triceps/code/1734/Added an constant allowing to boost the gradients for offsets in FloatNeuralNet, currently set to 1.Sergey BabkinWed, 19 Oct 2022 10:56:28 -0000https://sourceforge.net/p/triceps/code/1734/https://sourceforge.net/p/triceps/code/1733/Experimenting with FloatNeuralNet::applyGradient() and random inputs.Sergey BabkinWed, 12 Oct 2022 10:36:55 -0000https://sourceforge.net/p/triceps/code/1733/https://sourceforge.net/p/triceps/code/1732/Added FloatNeuralNet::applyGradient().Sergey BabkinWed, 12 Oct 2022 10:14:39 -0000https://sourceforge.net/p/triceps/code/1732/https://sourceforge.net/p/triceps/code/1731/More variants of gradient norms computed in FloatNeuralNet.Sergey BabkinWed, 12 Oct 2022 09:17:15 -0000https://sourceforge.net/p/triceps/code/1731/https://sourceforge.net/p/triceps/code/1730/Cleaned up the obsolete unused code (a separate loop for reclaiming neurons) from FloatNeuralNet test.Sergey BabkinWed, 12 Oct 2022 06:24:15 -0000https://sourceforge.net/p/triceps/code/1730/https://sourceforge.net/p/triceps/code/1729/Computation of total gradient in FloatNeuralNet.Sergey BabkinWed, 12 Oct 2022 05:59:16 -0000https://sourceforge.net/p/triceps/code/1729/https://sourceforge.net/p/triceps/code/1728/Test the FloatNeuralNet error computation with a non-moving "training pass".Sergey BabkinWed, 12 Oct 2022 02:37:24 -0000https://sourceforge.net/p/triceps/code/1728/https://sourceforge.net/p/triceps/code/1727/Computation of error during the training passes.Sergey BabkinTue, 11 Oct 2022 05:08:58 -0000https://sourceforge.net/p/triceps/code/1727/https://sourceforge.net/p/triceps/code/1726/Changed FloatNeuralNet::simpleDump() to use SubVector/SubMatrix.Sergey BabkinTue, 11 Oct 2022 02:51:34 -0000https://sourceforge.net/p/triceps/code/1726/