Assignment
(1) Overall Goals/Research Hypothesis
1-3 research questions to navigate/direct all your project.
• You may delay this section until (1) you study all previous work and (2) you do some analysis and understand the dataset/project
(2) (Previous/Related Contributions)
As most of the selected projects use public datasets, no doubt there are different attempts/projects to analyze those datasets. 30 % of this deliverable is in your overall assessment of previous data analysis efforts. This effort should include:
• Evaluating existing source codes that they have (e.g. in Kernels and discussion sections) or any other refence. Make sure you try those codes and show their results
• In addition to the code, summarize most relevant literature or efforts to analyze the same dataset you have picked.
• For the few who picked their own datasets, you are still expecting to do your literature survey in this section on what is most relevant to your data/idea/area and summarize those most relevant contributions.
(3) A comparison study
Compare results in your own work/project with results from previous or other contributions (data and analysis comparison not literature review)
The difference between section 3 and section 2 is that section 2 focuses on code/data analysis found in sources such as Kaggle, github, etc. while section 3 focuses on research papers that not necessary studied the same dataset, but the same focus area
(4) Preprocessing activities, Features Selection / Engineering
• What were the most important features?
• We suggest you provide:
• a variable importance plot (an example here about halfway down the page), showing the 10-20 most important features and
• partial plots for the 3-5 most important features
• If this is not possible, you should provide a list of the most important features.
• How did you select features?
• Did you make any important feature transformations?
• Did you find any interesting interactions between features?
• Did you use external data? (if permitted)
(5) Training Method(s)
• What training methods did you use?
• Did you ensemble the models?
• If you did ensemble, how did you weight the different models?
A6. Interesting findings
• What was the most important trick you used?
• What do you think set you apart from others in the competition?
• Did you find any interesting relationships in the data that don't fit in the sections above?
Many customers are happy to trade off model performance for simplicity. With this in mind:
• Is there a subset of features that would get 90-95% of your final performance? Which features? *
• What model that was most important? *
• What would the simplified model score?
• * Try and restrict your simple model to fewer than 10 features and one training method.
(6) Accuracy metrics reporting, charts, Model Execution Time
Many customers care about how long the winning models take to train and generate predictions:
• How long does it take to train your model?
• How long does it take to generate predictions using your model?
• How long does it take to train the simplified model (referenced in section A6)?
• How long does it take to generate predictions from the simplified model?
(7) Use of ensemble methods
Per the last chapter we have, make sure you employ at least two different ensemble models in your code and show the model details and results
References
Citations to references, websites, blog posts, and external sources of information where appropriate.
Summary
Summarize the most important aspects of your model and analysis, such as:
The training method(s) you used (Convolutional Neural Network, XGBoost)
The most important features
The tool(s) you used
How long it takes to train your model
Format your assignment according to the following formatting requirements:
1. The answer should be typed, double spaced, using Times New Roman font (size 12), with one-inch margins on all sides.
2. The response also includes a cover page containing the title of the assignment, the student's name, the course title, and the date. The cover page is not included in the required page length.
3. Also include a reference page. The Citations and references should follow APA format. The reference page is not included in the required page length.