My first Machine Learning experiment with real time data



Solving the most common problem predicting house prices in any suburb using supervised learning.

What's amazing is we shall build a Machine Learning model using MLJAR

MLJAR is a human-first platform for machine learning.
It provides a service for prototyping, development and deploying pattern recognition algorithms.
It makes algorithm search and tuning painless!

The basics of ML can be read anywhere on github/google.
What we need to know is regression/classification and when to use what. 


First things first test data:

train sample - (data_train.csv file) for model learning 
test samples (data_test.csv) for predictions



  1. Create a new project
  2. Select Regression as a task
  3. Add train and test data
    Note - When we add test dataset check the option: This dataset will be used only for predictions because we want to predict the sale price
  4. Specify columns that we use , target as "Saleprice column" in train data
  5. Dont use it for "Saleprice column" in test data
  6. ‘Accept attribute usage’ for both data sets
  7. Create a new experiment - For learning algorithm we will use Extreme Gradient Boosting (xgboost)
  8. metric to be optimized: Root Mean Square Error. (what is this?)
  9. And click Start!


To compute predictions check Predict view


Inspired from: https://medium.com/towards-data-science/regression-predict-house-price-lesson-2-5e23bec1c09d


Comments

Post a Comment

Popular posts from this blog

Software Testing @ Microsoft

Image
In continuation from my previous  series of posts  targeting testing in top few companies from the technology space. After  Software Testing @Facebook  and @Google  we shall now look at Microsoft: Testing@Microsoft Software Development Engineers in Test (SDETs) are usually just called Test and sometimes Software Testing. SDETs are responsible for maintaining high testing and qualityassurance standards for all Microsoft products. Software Development Engineers (SDEs) are often referred to as Software Development. SDEs write the code that drives Microsoft products and upgrades. Very few teams in Microsoft are still using SDETs to do significant amount of manual testing. Manual testing is mainly outsourced. Actually, as early as in 2004, for example, most of the manual testing of MSN Explorer was outsourced. Think about it this way: it just doesn't make sense for test manager to spend their headcount (SDETs) on something can be easily outsourced.  Until 2005, Microso
Read more

Trim / Remove spaces in Xpath?

Image
If you are wondering how you can trim the spaces in your xpath, this is how: The normalize-space function strips leading and trailing white-space from a string, replaces sequences of white-space characters by a single space, and returns the resulting string. Example : Which one is better? //td[starts-with(normalize-space(),'Text to Trim')] //td[starts-with(normalize-space(text()),' Text to Trim ')] The second option is better as it targets at the specific nodes More string functions in XPATH: Functions Description starts-with( string1 ,  string2 ) Returns true if the first string starts with the second string. contains( string1 ,  string2 ) Returns true if the first string contains the second string. substring( string offset length ) Returns a section of the string. The section starts at  offset (which is a number), and is as long as the value provided at  length. substring-before( string1 ,  string2 ) Returns the part of  string1  up unti
Read more