Subscribe to RSS feed
posted on 8 Mar 2016  -  17,100 views
previous article, I introduced a model which uses fundamental data to estimate Dividend Strength, P("same or more dividends next year" | "predicted to be giving same or more dividends next year"). Numerous people have shown interest in this estimation model, therefore I decided to spend more time improving its performance.
Its performance have increased from AUC (Area Under ROC) of 0.65 to 0.7. To put it simply, its performance when pitted against random guessing has improved from
30% (0.65 / 0.5)
to 40% (0.7 / 0.5), as
random guessing would give us an AUC of 0.5.
I have also added a
new page so that its results can be conveniently viewed.
This is more for my future reference. It is totally fine to skip this section.
The improved performance is via additional features, more powerful classifier and more training data.
Additional Features: Previously, features were simply added via the permutation of what is available. This round, I added new features using my domain knowledge of what might be useful for predicting future dividends. In addition, I also ensured that all metrics in iScreener are added as features whenever possible. I also added a new type of feature (SGXKeyStatsChangeRatioFeature). In total, the number of features has increased from 884 to 1305.
More Powerful Classifier: I changed Random Forest (100) to Random Forest (1000). This increased the training time, but since I am only rebuilding this model once a week, it is still fine.
More Training Data: Previously, I built the model using ten fold cross-validation and to increase the number of training data available, I increased it to twenty fold. This increased both training and testing time (20 instead of 10 models) but again, since I am only updating once a week, it is still acceptable.
Next Article >
< Previous Article
SGXcafe Turns One! Thank You!
Do You Keep Your Extra Cash in ...
List All Articles
Other articles by evankoh
MemCached For A Faster StocksCafe
Since the drastic move to re-architecture StocksCafe and adding support for two new markets at the same time in April, StocksCafe website have became slower. I am aware of that and have been taking significant amount of time trying to improve it. To be very honest, I am not 100% sure what is the true cause although I am inclined to think that it is due to a summation of reasons such as poor database ...
SGXcafe Now Supports Multiple Portfolios
Recently, quite a few users have independently requested for the ability to have multiple portfolios in a single account. It seems typical to have multiple investment accounts, such as CDP, CPF, and SRS. Although this seems like a straightforward feature, it actually requires significant amount of time and effort to build because: 1. SGXcafe was built with the assumption of one portfolio per account, ...
SGXcafe Will Continue To Stay Free
Long Story Short SGXcafe will continue to be free, but to cover for the high operating costs due to licensing, I would like to invite you to do one or more of the following if you would like to show your support for SGXcafe. 1) Help increase awareness of SGXcafe. You can do this via your blog, share SGXcafe's articles on facebook, or simply via word of mouth to people whom you believe can benefit from ...