Wednesday, June 10, 2015

It has been some time... Or what I have been up to...

Since my last post, I think I have given up on posting blog entries for a while. It was a pretty busy time frame though: Moving to Seattle for Microsoft, finishing up a couple of final papers and writing for 2 book projects. Plus I think I did more paper reviews than I had done in my entire grad school time, pretty time consuming stuff those reviews... And of course these are somewhat side projects, for the past 2 years I have been working as a software engineer under Bing Ads providing metrics and data insight for core Bing Ads teams. It has been an awesome experience on its own right so far, but it deserves another post to share some ideas about academia and industry.

Outside of work, most of my time was dedicated to book projects that I was lucky enough to be involved in. The first book that I had the chance to co-author, with amazing collaborators Tim Menzies, Leandro Minku, Fayola Peters and Burak Turhan, is called "Sharing Data and Models in Software Engineering" (here is the Amazon link: http://bit.ly/shrngDtMdls). I would like to think that different parts of this book speak to different levels of comfort with various data mining and machine learning techniques. The book is mainly divided into 4 parts. The first two parts start with high level discussions of how to approach a data science project, what factors to consider in terms of user engagement and data collection, then it continues with a brief tutorial on common concepts such as instance and feature selection, algorithms for prediction and clustering and so on. The other two parts deal with more advanced material such as transfer learning, active learning and data privacy. The whole book is a nice overhaul of the practical research we have been doing in the past couple of years. Particularly for data scientists and researchers with a focus on software engineering data, the book can provide a nice revisit of fundamental concepts as well as some more advanced ideas to try out on their data sets.

Machine Learning and Data Science Conference
at Microsoft, explaining the steps, ideas and pitfalls
 that led to our chapter  in
"The Art and Science of Analyzing Software Data"
Another project that I was lucky to take part is somewhat a sequel to the first book, which is called "The Art and Science of Analyzing Software Data: Analysis Patterns" (the Amazon link: http://bit.ly/analysisPatterns). This book is the result of a joint effort from various prominent research groups in the junction of data science and software engineering and it was edited by Christian Bird, Tim Menzies and Thomas Zimmermann. Besides awesome folks involved in this project, what makes this book really cool is that it is a distillation of various research groups' approaches to data science. In other words, it was a reflection time for the researchers to step back and ask: "Hey, what were we doing all along in all these projects? What are the patterns that we instinctively follow, can we distill this information into a formal structure and share?" My contribution to this book is being a co-author of a chapter with the amazing co-authors: Ayse Basar Bener, Ayse Tosun Misirli, Bora Caglayan and Gul Calikli. We have worked together in multiple data science projects in a number of different companies and successfully delivered tangible business outcomes for these companies. In our chapter entitled "Lessons Learned from Software Analytics in Practice", we share the patterns that worked for us in multiple data science projects. Of course there were a ton of pitfalls that we learned along the way, which are probably as important as the patterns to be aware of. In this chapter we also share these pitfalls and our recommendations as to how we have avoided them in the past.

In case you are embarking on a career in data science or you want to see how other research groups in software engineering have approached data science projects, you may also want to take a look at these books.



110 comments:

  1. Replies
    1. I am technology Enthusiast. Your blog is really awesome, attractive and impressive. I like the way you think. it is very useful for Java SE & Java EE Learners. Your article adds best knowledge to our Java Online Training in India. or learn thru Java Online Training in India Students. or learn thru JavaScript Online Training in India. Appreciating the persistence you put into your blog and detailed information you provide. Kindly keep blogging.

      Delete
  2. Excellent Sharing. You have done great job. I gathered lots of new information. . Devops Online Training | Data Science Online Training

    ReplyDelete
  3. Hi, I am really happy to found such a helpful and fascinating post that is written in well manner. Thanks for sharing such an informative post.R Programming Online Training | Hadoop Online Training

    ReplyDelete
  4. Hi, I am really like this blog post. We write this blog very good manner.Thank you so much such a fantastic post.
    Selenium Training in Chennai
    Selenium Course in Chennai
    Selenium Training in Velachery

    ReplyDelete
  5. hai i am isabella,this post very helpful for me.Thank you so much for sharing...... Dot Net Training in Anna nagar

    Dot Net Training in Chennai

    ReplyDelete
  6. hi welcome to this blog. really you have post an informative blog. it will be really helpful to many peoples. thank you for sharing this blog.
    selenium training in chennai

    ReplyDelete
  7. hi welcome to this blog. really you have posted an informative blog. it will be really helpful to many peoples.
    android training in chennai

    ReplyDelete
  8. hi welcome to this blog. really you have post an informative blog. it will be really helpful to many peoples. thank you for sharing this blog.
    java training in chennai

    ReplyDelete
  9. Well Said, you have furnished the right information that will be useful to anyone at all time. Thanks for sharing your Ideas. Data Science Training in Chennai

    ReplyDelete
  10. Hats off to your presence of mind..I really enjoyed reading your blog. I really appreciate your information which you shared with us.
    Data Science Online Training

    ReplyDelete
  11. Hi, I am really happy to found such a helpful and fascinating post that is written in well manner. Thanks for sharing such an informative post..Big Data Hadoop Training in Bangalore | Data Science Training in Bangalore

    ReplyDelete
  12. Impressive and interesting article, thanks for sharing your information... keep rocks and updating...

    Dot Net Training in chennai | Dot Net Training institute in chennai

    ReplyDelete
  13. It's interesting that many of the bloggers to helped clarify a few things for me as well as giving.Most of ideas can be nice content.The people to give them a good shake to get your point and across the command.


    Hadoop Training in Marathahalli|
    Hadoop Training in Bangalore|
    Data science training in Marathahalli|
    Data science training in Bangalore|

    ReplyDelete
  14. hi admin.i am really love it your blog.Because your explanation wise all the topics are too good.I got enough knowledge from your blog.Thanks for sharing more..
    Data Science Training in BTM Layout
    Java Training in Marathahalli

    ReplyDelete
  15. That is very interesting; you are a very skilled blogger. I have shared your website in my social networks! A very nice guide. I will definitely follow these tips. Thank you for sharing such detailed article. Java Training in Chennai | Data Science Training in Chennai

    ReplyDelete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.
    Data Science Training in Bangalore

    ReplyDelete
  18. Very nice post to keep sharing.. Thanks for giving very nice information from your post..
    Mobile Computing Project Center in Chennai | Mobile Computing Project Center in Velachery

    ReplyDelete
  19. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts, have a nice weekend!


    https://www.besanttechnologies.com/training-courses/data-science-training-in-bangalore

    ReplyDelete
  20. Really awesome blog. Your blog is really useful for me. Thanks for sharing this informative blog. Keep update your blog...
    MBA Project Center in Chennai | MBA Project Center in Velachery

    ReplyDelete
  21. Informative post about hadoop, i am looking forward for realtime hadoop online training institute.

    ReplyDelete
  22. Good post and I like it very much. By the way, anybody try this app development company for iOS and Android? I find it is so professional to help me boost app ranking and increase app downloads.

    ReplyDelete
  23. Excellent Article ...thank u for sharing, such a valuable content Learners to get good knowledge after read this article.. Data Science Training in Chennai

    ReplyDelete
  24. It has been simply incredibly generous with you to provide openly what exactly many individuals would’ve marketed for an eBook to end up making some cash for their end, primarily given that you could have tried it in the event you wanted.

    Data Science Training in Bangalore


    DataScience Training in Chennai


    ReplyDelete
  25. Thanks a lot very much for the high quality and results-oriented help. I won’t think twice to endorse your blog post to anybody who wants and needs support about this area. data science training in bangalore.

    ReplyDelete
  26. Thanks a lot very much for the high quality and results-oriented help. I won’t think twice to endorse your blog post to anybody who wants and needs support about this area.

    java training in bangalore

    ReplyDelete
  27. Your new valuable key points imply much a person like me and extremely more to my office workers. With thanks.

    Hadoop online Training\Informatica Online Training\ETL Testing Online Training

    ReplyDelete
  28. Appreciation for really being thoughtful and also for deciding on certain marvelous guides most people really want to be aware of.

    AWS Training in Chennai

    ReplyDelete
  29. Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.
    big-data-hadoop-training-institute-in-bangalore

    ReplyDelete
  30. I believe that there will be good opportunities for those who are coming around this area.
    Best Online Software Training Institute | Data Science Training

    ReplyDelete
  31. I just wanna say one word yet thanks for the suggestions that you are contributed here. Please do keep updating...
    Best Online Software Training Institute | Big Data Analytics Training

    ReplyDelete
  32. I believe there are many more pleasurable opportunities ahead for individuals that looked at your site.

    Selenium Training in Bangalore

    Selenium Training in BTM

    Selenium Training in Rajaji Nagar

    ReplyDelete
  33. Aw, this was a very nice post. In thought I wish to put in writing like this moreover – taking time and precise effort to make a very good article… however what can I say… I procrastinate alot and by no means seem to get something done.
    Data Science Training in Hyderabad

    ReplyDelete
  34. This is very nice post. I am into java development now and want to move to big data. I heard INSOFE is good big data analytics training institute in hyderabad. Any recommendations, please?

    ReplyDelete

  35. Informative post! I really like and appreciate your work, thank you for sharing such a useful information about motivational management objectives, keep updating the information, hear i prefer some more information about Best Event Management Institute Mumbai

    ReplyDelete
  36. Nice post.Thank you so much for sharing.Yiioverflow is a web development company.We have well expert team in Angular JS, Ionic, Yii Framework, Node JS, Laravel, PHP, MySQL, and WordPress.If you want a developer visit.. https://yiioverflow.com/

    ReplyDelete
  37. Your blog was very interesting & easy to understand. Thank you so much sharing that informative blog.Inventory Audit

    selenium training in chennai

    aws training in chennai


    ReplyDelete
  38. Thanks for one marvelous posting! I enjoyed reading it; you are a great author. I will make sure to bookmark your blog and may come back someday. I want to encourage that you continue your great posts, have a nice weekend!
    Online training in USA

    ReplyDelete
  39. It has been simply incredibly generous with you to provide openly what exactly many individuals would’ve marketed for an eBook to end up making some cash for their end, primarily given that you could have tried it in the event you wanted.
    Online training in USA

    ReplyDelete
  40. I have to voice my passion for your kindness giving support to those people that should have guidance on this important matter.
    Click here:
    Online training in USA

    ReplyDelete
  41. Your very own commitment to getting the message throughout came to be rather powerful and have consistently enabled employees just like me to arrive at their desired goals.
    Click here:
    Online training in USA

    ReplyDelete
  42. Your good knowledge and kindness in playing with all the pieces were very useful. I don’t know what I would have done if I had not encountered such a step like this.

    Online training in USA

    ReplyDelete
  43. I believe there are many more pleasurable opportunities ahead for individuals that looked at your site. Online training in USA

    ReplyDelete
  44. wow great Article, the details you have provided are much clear, easy to understand, if you post some more Article, it will be very much useful for me.
    Android Training in Chennai

    ReplyDelete
  45. Very nice post to keep sharing... Thanks for giving very nice information from your post… Python Training in Chennai | Pega Training in Chennai

    ReplyDelete
  46. Informative blog thanks for providing such a great information.
    Data science training in Chennai

    ReplyDelete
  47. Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us. Do check Six Sigma Training in Bangalore | Six Sigma Training in Dubai & Get trained by an expert who will enrich you with the latest trends.

    ReplyDelete
  48. Interesting blog post. This blog shows that you have a great future as a content writer. Java Training in Chennai | RPA Training in Chennai

    ReplyDelete
  49. This comment has been removed by the author.

    ReplyDelete
  50. The blog you posted was very easy to read and understand. After reading this blog I gathered lot of information. Thank You for sharing the valuable information. Data Science Training in HyderabadData Science Training in Hyderabad

    ReplyDelete
  51. Hello! I just would like to give a huge thumbs up for the great info you have here on this post. I will be coming back to your blog for more soon.
    getkingrootapk.info

    ReplyDelete
  52. This comment has been removed by the author.

    ReplyDelete
  53. There are certainly a lot of details like that to take into consideration. That is a great point to bring up. I offer the thoughts above as general inspiration but clearly there are questions like the one you bring up where the most important thing will be working in honest good faith. I don?t know if best practices have emerged around things like that, but I am sure that your job is clearly identified as a fair game. Both boys and girls feel the impact of just a moment?s pleasure, for the rest of their lives.
    https://ifreedownloadings.com/

    ReplyDelete
  54. Thanks for sharing this valuable information.. I saw your website and get more details..Nice work...
    Java Training in Chennai | Java Training in Kanchipuram

    ReplyDelete
  55. All the points you described so beautiful. Every time i read your blog content and i so surprised that how you can write so well.
    Android Training in Chennai | Android Training in Kanchipuram

    ReplyDelete
  56. Thanks for sharing such a great information.Its really nice and informative great content of different kinds of the valuable information's.The style of writing is excellent and also the content is top-notch. Thanks for that shrewdness you provide the readers!

    Oracle PLSQL Training in Chennai
    Oracle PLSQL Training

    ReplyDelete
  57. It's very great post... Really you are... done a wonderful job Keep up the good work and continue sharing like this.
    Robotic Process Automation Training in Chennai | Robotic Process Automation Training in Taramani

    ReplyDelete
  58. The knowledge of technology you have been sharing thorough this post is very much helpful to develop new idea. here by i also want to share this.
    Best Devops training in sholinganallur
    Devops training in velachery
    Devops training in annanagar
    Devops training in tambaram

    ReplyDelete
  59. I found your blog while searching for the updates, I am happy to be here. Very useful content and also easily understandable providing.. Believe me I did wrote an post about tutorials for beginners with reference of your blog. 
    Java training in Bangalore | Java training in Marathahalli | Java training in Bangalore | Java training in Btm layout

    Java training in Bangalore | Java training in Marathahalli | Java training in Bangalore | Java training in Btm layout

    ReplyDelete
  60. Excellant post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.
    python course institute in bangalore | python Course institute in bangalore| python course institute in bangalore

    ReplyDelete
  61. This is really too useful and have more ideas from yours. keep sharing many techniques and thanks for sharing the information.
    iOS Training in Chennai | iOS Training in Tambaram

    ReplyDelete
  62. This is a nice post in an interesting line of content.Thanks for sharing this article.
    Dot net Training in Chennai | Dot net Training in Perungudi

    ReplyDelete
  63. Nice post. This post is very helpful. Thank you so much for sharing this post….
    Python Training in Chennai | Python Training in Madipakkam

    ReplyDelete
  64. All the points you described so beautiful. Every time i read your blog content and i so surprised that how you can write so well.
    ISTQB Training in Chennai | ISTQB Training in Guindy

    ReplyDelete
  65. Thanks for sharing your valuable information..its really useful to us.keep updating.Data Science Online Training in Hyderabad

    ReplyDelete
  66. This is a nice post in an interesting line of content.Thanks for sharing this article.
    Java Training in Chennai | Java Training in Chrompet

    ReplyDelete
  67. very interesting topic.Helps to gain knowledge about lot of information. Thanks for posting information in this blog.
    Graphic Designing Training in Chennai | Graphic Designing Training in Keelkattalai

    ReplyDelete
  68. Very good and informative article. Thanks for sharing such nice article, keep on updating such good articles.
    Ethical Hacking Training in Chennai | Ethical Hacking Training in Thiruvanmiyur

    ReplyDelete
  69. Nice post. This post is very helpful. Thank you so much for sharing this post….
    Java Training in Chennai | Java Training in St.Thomas Mount

    ReplyDelete
  70. I am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.
    Java Training in Chennai | Java Training in Meenambakkam

    ReplyDelete
  71. Really i enjoyed very much. And this may helpful for lot of peoples. So you are provided such a nice and great article within this.
    Best Software Testing Training Institute in Chennai | Best Software Testing Training Institute in T.Nagar

    ReplyDelete
  72. I am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.
    Software Testing Course in Chennai | Software Testing Course in Perungudi

    ReplyDelete
  73. Really i enjoyed very much. And this may helpful for lot of peoples. So you are provided such a nice and great article within this.
    Best Ethical Hacking Training Institute in Chennai | Best Ethical Hacking Training Institute in Velachery

    ReplyDelete
  74. Thanks you for sharing the article. The data that you provided in the blog is infromative and effectve. Through you blog I gained so much knowledge. Also check my collection at machine learning online course Blog

    ReplyDelete
  75. When I initially commented, I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several emails with the same comment. Is there any way you can remove people from that service? Thanks.

    AWS Training in Bangalore | Amazon Web Services Training in Bangalore
    Amazon Web Services Training in Pune | Best AWS Training in Pune
    AWS Online Training | Online AWS Certification Course - Gangboard
    Top 10 AWS Interview Question and Answers

    ReplyDelete
  76. Nice Post! It is really interesting to read from the beginning and Keep up the good work and continue sharing like this.
    Robotic Process Automation Training course in Chennai | Robotic Process Automation Training course in T.Nagar

    ReplyDelete
  77. Appreciating the persistence, you put into your blog and detailed information you provide.
    nebosh course in chennai

    ReplyDelete
  78. Thanks its Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us.
    Software Testing Course in Chennai | Software Testing Course in Keelkattalai

    ReplyDelete
  79. This blog very easily understandable. Thanks for sharing such an informative post with us.This is a nice post in an interesting line of content.
    IOS Training Institute in Chennai | IOS Training Institute in Pallavaram

    ReplyDelete
  80. It's very great post... Really you are... done a wonderful job Keep up the good work and continue sharing like this.
    Selenium Automation Course in Chennai | Selenium Automation Course in Pallikaranai

    ReplyDelete
  81. Awesome post. Really you are shared very informative concept... Thank you for sharing. Keep on updating...
    Best Java J2EE Training Institute in Chennai | Best Java J2EE Training Institute in Madipakkam

    ReplyDelete