Ayurvedic Astrology
  • Home
  • Astrology Readings
    • Bookings
    • Vintage Reviews
    • World Renown
  • Resources
    • Media >
      • Articles
    • Calculators >
      • Astrology Centric >
        • Any Asteroid
        • Calendar Convert
        • Find Location DMS
        • Katapayadi Calculator
        • Real-time Gold & Silver Prices
        • Simple Star Calculator
        • Varsha Phala and Tithi Pravesh Location Finder
        • Earthquake Predictor
      • AI Centric >
        • Ask Charak
        • Handwriting Analysis
        • History Predictor
        • Personality Trait Predictor
        • TruthBot
    • Research >
      • Bibliography
      • Coding
      • NASA Research Tool
      • Degrees Spreadsheet
    • Privacy Policy
  • Store
    • Astrology
    • Jewelry
    • Lifestyle
  • About
    • Location
    • Contact
    • Newsletter

Ridiculously Good Results Again for the Amazon Misspelling Rates Data Using BigML's DeepNet

2/19/2018

12 Comments

 
[Edit: The latest and greatest on this project, including source files, can be seen at ​the publication link here.]
I have posted a few times here about a rich dataset that I have.

Data were obtained from Stanford's SNAP data repository of Amazon.com reviews that gave daily misspelling rates; astronomical data were from Wolfram's Mathematica software and its astronomy resources.

Here is what the dataset looks like. Click on each picture to enlarge.
Picture
Each of the 5296 rows represents a sequential day in a 14.5 year span of Amazon review misspelling rates during Jan 1, 2000 to Jul 1, 2014.

Across the top are the labels. In each column is a simple, stable, linear function of the right ascension (i.e., the astrological Tropical degree) of the planet, moon, or star at midnight at the start of that day in London, UK. Retrogressions of the planets are also included.

The final column is the log of difference of the misspelling rate of the day from the 27-day SNIP baseline. (The Moon's right ascension completes its cycle every 27 and change days. That is the shortest cycle for any of the right ascensions.) Thus, it is the data over time minus its background noise. The following is a graph of this column's data over time.
Picture
SNIP stands for Sensitive Nonlinear Iterative Peak-clipping algorithm. This method preserves any cyclic patterns -- such as the planetary placements and retrogressions -- while discarding "background noise" in the data, which would tend to obfuscate the patterns. The SNIP method is not subjective. It comes out of processing signals within spectra and is unprejudiced. Note that the SNIP method comes from signal processing and tends to preserve cyclic behavior in spectra.

The apparent cyclicity hidden within this data is revealed via a correlelogram:
Picture
The thin bands represent the start and end of Mercury retrograde across 14.5 years with Mercury retrograde analysis being the original motivator for acquiring this data.

​​For today's study, the data for the first 80% of days were developed into a training group, and that of the subsequent 20% of days were isolated as a test group for prediction.

What was doing the training and testing? They were done entirely by an automated machine learning (AI) algorithm from BigML.com called DeepNet.  DeepNet* was applied to the training set of the first 80% of days. This DeepNet was then tested or evaluated on the last 20% of days. The DeepNet is a hands-off technique offered to anyone for free.

The chart below displays ridiculously good results as given in the usual AI industry way: the error rates for predictions for the 20% test group by DeepNet (in green) is dramatically smaller than other standard methods of prediction, in gray, which are based on the mean (average) rate of the training data or an approach assuming random chance. Moreover, the strong R-squared suggests good correlation of predicted misspelling rates to actual values only for the astronomical data of the DeepNet.

Read More
12 Comments

    ARTICLES

    Author

    Renay Oshop - teacher, searcher, researcher, immerser, rejoicer, enjoying the interstices between Twitter, Facebook, and journals.

    Categories

    All
    Astrology
    Ayurveda
    Cooking
    Math
    Miscellaneous
    Research
    Sanskrit
    Yoga

    RSS Feed

    Archives

    January 2023
    December 2022
    November 2022
    April 2022
    March 2022
    October 2021
    September 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    July 2020
    June 2020
    April 2020
    March 2020
    February 2020
    January 2020
    October 2019
    September 2019
    February 2019
    January 2019
    October 2018
    February 2018
    January 2018
    November 2017
    October 2017
    February 2017
    January 2017
    June 2016
    February 2016
    December 2015
    November 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    March 2015
    April 2014
    February 2014
    January 2014
    January 2013
    December 2012
    October 2012
    May 2012
    April 2012
    February 2012
    January 2012
    November 2011
    July 2011
    April 2011
    December 2010
    November 2010
    October 2010
    September 2010
    August 2010
    June 2010
    January 2010
    October 2009
    July 2009
    May 2009
    February 2009
    January 2009
    November 2008
    October 2008
    September 2008
    August 2008
    July 2008
    June 2008
    May 2008
    April 2008
    June 2002

© 2008–2022  Renay Oshop  AyurAstro®
  • Home
  • Astrology Readings
    • Bookings
    • Vintage Reviews
    • World Renown
  • Resources
    • Media >
      • Articles
    • Calculators >
      • Astrology Centric >
        • Any Asteroid
        • Calendar Convert
        • Find Location DMS
        • Katapayadi Calculator
        • Real-time Gold & Silver Prices
        • Simple Star Calculator
        • Varsha Phala and Tithi Pravesh Location Finder
        • Earthquake Predictor
      • AI Centric >
        • Ask Charak
        • Handwriting Analysis
        • History Predictor
        • Personality Trait Predictor
        • TruthBot
    • Research >
      • Bibliography
      • Coding
      • NASA Research Tool
      • Degrees Spreadsheet
    • Privacy Policy
  • Store
    • Astrology
    • Jewelry
    • Lifestyle
  • About
    • Location
    • Contact
    • Newsletter