Data Science for Social Systems

Emilio Ferrara (Professor of Computer Science at USC) & (HUmans | MAchines | Networks | Society) Lab


CSCI 599 Special Topics: Data Science for Social Systems
MRF 340 / Friday, 1.00-4.20pm
Prof. Emilio Ferrara & Dr. Fred Morstatter / TAs: Ashok Deb, Akira Matsui, Yilei Zeng
Questions? Join the class Slack channel!
[Last Update: July 27, 2018]


Mining the Social Web

Johnny Mnemonic (1995) — © TriStar Pictures


Course description and learning objectives

Learn how to unleash the full power and potential of Social Web data for research and business application purposes!

The Social Web pervades all aspects of our lives: we connect and share with friends, search for jobs and opportunities, rate products and write reviews, establish collaborations and projects, all by using online social platforms like Facebook, LinkedIn, Yelp and GitHub. We express our personality and creativity through social platforms for visual discovery, collection and bookmarking like Tumblr and Pinterest. We keep up-to-date, communicate and discuss news and topics of our interest on Twitter and Reddit.

In this course, we will explore the opportunities provided by the wealth of social data available from these platforms. You will learn how to acquire, process, analyze and visualize data related to social networks and media activity, users and their behaviors, trends and information spreading. This journey will bring through the lands of data mining and machine learning methods: supervised and unsupervised learning will be applied to practical problems like social link analysis, opinion mining, and building smart recommender systems. We will explore open-source tools to understand how to extract meaning from human language, use network analysis to study how human connect and discover affinities among people’s interests and tastes by building interest graphs.

Taking this course, you should expect to learn about:

  • Supervised learning: Crush course on Data Classification.
    • Eager vs. Lazy learning: Decision Tree and k-Nearest Neighbors.
    • Probabilistic models: Näive Bayes classifier.
    • Ensemble methods, bagging and boosting: Random Forest and AdaBoost.
    • Classification performance evaluation: Precision/Recall/F1, Accuracy and ROC Curves.
  • Unsupervised learning: Crush course on Clustering Data.
    • Distance and similarity measures & K-means clustering.
    • Hierarchical Clustering and Dendrograms.
    • Density-based clustering.
    • Clustering performance evaluation.
  • Applications of texts and documents analysis.
    • Natural Language Processing and Part-of-speech tagging.
    • Sentiment Analysis.
    • Topic Modeling.
  • Networks:
    • Statistical descriptors of networks: link analysis, centrality, and prestige.
    • Network clustering: modularity and community detection.
    • Dynamics of information and epidemics spreading: threshold and information cascade models.
    • Network visualization algorithms: spring-like layouts, multidimensional scaling, Gephi.
  • Intelligent systems:
    • Recommender systems & Collaborative filtering
    • Matrix factorization

All topics will be explored from an applied, practical, computational perspective. This will allow the interested student to deepen the rigorous theoretical implications of the methods in other courses offered by USC (for example, CSCI-567 Machine Learning). Throughout the course, we will deliver several “hands-on” sessions with live coding, data analysis, and problem-solving!

Prerequisites

A basic understanding of programming that will allow you to manipulate data and implement basic algorithms, using any programming language, is recommended. Python will be the “official” programming language used during the hands-on sessions and for learning purposes. We will use IPython Notebook as the environment. However, feel free to use the language you prefer for your assignments and class project. A basic understanding of statistics and algebra will help too.

Books and learning material

Required textbooks (total Amazon price [new/used]: $100/$60)

  1. Web Data Mining (2nd Ed.) —by Bing Liu (Amazon price [new/used]:  $48/$35)
  2. Mining the Social Web (2nd Ed.) —by Matthew A. Russell (Amazon price [new/used]:  $27/$15)
  3. Programming Collective Intelligence —by Toby Segaran (Amazon price [new/used]:  $25/$10)
  4. Network Science Book —by Laśzló Barabási (FREE: http://barabasilab.neu.edu/networksciencebook/)
  5. Dive into Python —by (FREE: http://www.diveintopython.net/)

Some details: (1) will provide insights on methods and approaches studied throughout the course from a machine learning perspective; (2) and (3) will serve as recipe books to effectively design and make those methods work with Social Web data; (4) and (5) are free resources we will exploit to gather additional material on networks and Python programming.

Technical, recommended (non-required) Python “cookbooks”:

  • Python Data Visualization Cookbook —by Igor Milovanović (ebook: $14)
  • Learning IPython for Interactive Computing and Data Visualization —by Cyrille Rossant (ebook: $10)
  • Learning scikit-learn: Machine Learning in Python —by Raúl Garreta and Guillermo Moncecchi (ebook: $10)

Policy & Grading

Class participation and engagement are essential ingredients for success in your academic career, therefore during class turn off cell phones and ringers (no vibrate mode), laptops and tablets. The only exception to use laptops during class is to take notes. In this case, please sit in the front rows of the classroom: no email, social media, games, or other distractions will be accepted. Students will be expected to do all readings and assignments, and to attend all meetings unless excused, in writing, at least 24 hours prior. This is the (tentative) system that will be employed for grading:


Component Weight Description



Participation 15% Class participation, weekly presentation, and engagement. Attendance is mandatory.
Assignments 20% Five assignments on social Web data analysis and modeling.
Midterm exam 30% Mid-term Hackathon (grading will be informed by a peer-review system).
Final exam 35% Final project paper.

The following misconducts will automatically result in a zero weight for that component of the grade: (1) failing to attend class on the day of your presentation; (2) failing to turn in the assignments by the expected dates; (3) failing to attend meetings of your group’s Hackathon and/or final presentation; (4) failing to submit your final paper by the expected date. Extenuating circumstances will normally include only serious emergencies or illnesses documented with a doctor’s note.

Readings & discussion

At the beginning of each lecture (starting lecture 2), one student will hold a 10m presentation on one daily reading and moderate a 5m discussion about it. The list of required readings is available at the end of the syllabus.

Assignments

Throughout the course, there will be five assignments to be carried out independently by each student. The goal of these assignments is to allow you to track your own progress and understand whether you are grasping the essential concepts of the course. They will occur tentatively at the end of each of the five parts the course plan (see Syllabus). The assignments will consist of part “theory” (including material from the mandatory readings) and part coding tasks. They will be based on topics, problems and questions discussed during class each week.

Mid-Term Hackathon

The mid-term exam is in the form of a collaborative hackathon.The goal is to develop crucial abilities such as:

  • Intellectual development: leveraging expertise and multidisciplinary backgrounds, sharing ideas and knowledge.
  • Teamwork skills: effective brainstorming, communication and presentation, and group problem-solving.
  • Project management skills: ability to set goals, map progress, prototyping-delivery, and matching deadlines.

We expect participants to form groups of 3 or 4 members with the goal of solving a single problem. Graduate students are encouraged to form groups of three. Each group will receive a different problem.

We will propose several problems of interest for the course, as well as receive your explicit solicitations, that should be submitted by 3 days from the beginning of the mid-term week, in the form of a short one-page proposal clearly stating:

  • What is the problem?
  • Why it is deemed relevant.
  • How the group plans to solve the problem.
  • Bibliographic references to at least one relevant related paper.

All project proposals will be subject to our approval. Groups will be assigned an approved project, either selected among those proposed by the Instructor, or by the group itself. The rules of the hackathon will be released the week before the mid-term. Each group will receive a 15m slot for the presentation of their results, in which each member of the group is expected to discuss at least one critical task of the project. The grading of the projects will be in part based on crowd-sourced ratings attributed by other fellow students and submitted in anonymous form at the end of each presentation day.

Final Paper

A serious final paper will be expected. The manuscript will be at least 2,500 words and will include appropriate figures and tables. The work should cover the following points:

  • Statement of the problem & Why the problem is important.
  • How the problem was faced —including a description of methodology and dataset(s).
  • Discussion of results, findings, and limitations of the study.
  • Related literature & Final remarks/conclusions.

Ideally, the final paper is based on the student’s mid-term hackathon project. Text with other group members cannot be shared, figures/tables can be shared when appropriate with proper credit attribution. Grading will be based on soundness (both quality and quantity of original work). Groups composed of three graduate students will be allowed (upon written permission) to turn in a single joint-authored manuscript, in the format of a submission for an appropriate peer-reviewed journal or conference. Each author must contribute sufficient material to justify his/her “equal contribution” in the work.

Academic integrity

The principles of academic honesty and professional ethics will be vigorously enforced in this course, following the IU Code of Student Rights, Responsibilities, and Conduct, the Informatics Academic Regulations, and the CS Program Statement on Academic Integrity.

This includes the usual standards on an acknowledgment of help, contributions and joint work, even when you are encouraged to build on libraries and other software written by other people. Any code or other assignments you turn in for grading and credit must be your individual work (except for group projects). Even if you work with a study group (which is encouraged), the work you turn in must be exclusively your own. If you turn in work done together with, or with the assistance of, anyone else other than the instructors, this is an instance of cheating.

Cases of academic misconduct (e.g., cheating, fabrication, plagiarism, interference, or facilitating academic dishonesty) will be reported to the Office of the Dean of Students. Typical consequences include an automatic F grade in the course.

Your submission of work to be graded in this class implies acknowledgment of this policy. If you need clarification or have any questions, please see the instructor during office hours.

Final remarks

We would like to hear from anyone who has a disability or other issues that may require some modifications or class adjustments to be made. The offices of Disability Services and Psychological Services are available for assistance to students. Please see the instructor after class or during office hours.

We welcome feedback on the class organization, material, lectures, assignments, and exams. You can provide us with constructive criticism. Please share your comments and suggestions so that we can improve the class.

On the cover: Johnny Mnemonic

Johnny Mnemonic is a cyberpunk sci-fi cult movie from the early nineteens, adapted from the homonymous short story by William Gibson. It tells the story of Johnny, a data courier, nicely interpreted by a Keanu Reeves in his early career, struggling with a huge load of data stored in his head. I find it a nice metaphor of our current data-overloaded society, and, coincidentally, is one of the defining movies I watched as a teenager that brought me to love Computer
Science.

[version 0.2: June 25, 2016]

Syllabus


Part 1—Supervised Learning


 Supervised Learning


Week One

  • Introduction of the course & Crash intro to Supervised learning.
    Readings: Papers [17] and [11] — Chapters: WDM:3.1
  • Eager vs. Lazy learning—Decision Tree & k-Nearest Neighbors.
    Readings: Papers [21] — Chapters: WDM:3.2 and WDM:3.9

Week Two

  • Ensemble methods, bagging and boosting & Classification performance evaluation.
    Readings: Papers [9] — Chapters: WDM:3.3 and WDM:3.10
  • hands-on session: mining Twitter.
    Readings: Papers [12] — Chapters: MtSW:1[pp.5-26]
    Documentation: Twitter API (https://dev.twitter.com/)

Week Three

  • hands-on session: mining Twitter.
    Readings: Papers [29] — Chapters: MtSW:1[pp.26-44]
  • hands-on session: mining Twitter.
    Readings: Papers [36] — Chapters: PCI:7[pp.142–165]


Part 2—Unsupervised Learning


 Unsupervised Learning


Week Four

  • Crash introduction to Unsupervised learning—Distance measures & K-means clustering.
    Readings: Papers [38] and [37] — Chapters: WDM:4.1–4.3[pp.133–147]
  • hands-on session: mining Twitter.
    Readings: Papers [19] — Chapters: 9[pp.351–396]

Week Five

  • Hierarchical clustering & Dendrograms.
    Readings: Papers [24] — WDM:4.3–4.5[pp.147–155]
  • hands-on session: mining LinkedIn.
    Readings: Papers [34] — Chapters: MtSW:3[pp.89–132]
    Documentation: LinkedIn API (https://developer.linkedin.com/apis)

Week Six

  • Density-based clustering & Clustering performance evaluation
    Readings: Papers [30] — Chapters: WDM:4.6–4.10[pp.155–165]
  • hands-on session: mining LinkedIn.
    Readings: Papers [14] — PCI:3[pp.29–53]


Part 3—Text and Documents


 Text and Documents


Week Seven

  • Natural Language Processing & Part-of-Speech Tagging.
    Readings: Papers [16] — Chapters: WDM:6.5 and MtSW:5.3–5.5[pp.190–222]
  • Sentiment Analysis & hands-on session: mining Google+.
    Readings: Papers [15] — Chapters: MtSW:4[pp.135–180]
    Documentation: Google+ API (https://developers.google.com/+/api)

Week Eight

  • Topic modeling.
    Readings: Papers [2] — Chapters: WDM:6.7
  • hands-on session: mining Instagram.
    Readings: Papers [5] and [6]
    Documentation: Instagram API (http://instagram.com/developer/)

Week Nine: Mid-term Hackathon week

  • Mid-term Hackathon presentations

Fall break: TBD


Part 4—Networks


 Networks


Week Ten

  • Crash introduction to Networks—Statistical descriptors of networks.
    Readings: Papers [22] and [4] — Chapters: NSB:1 and NSB:2
  • hands-on session: mining Facebook.
    Readings: Papers [7] — Chapters: WDM:7.1 and WDM:7.3–7.4 and MtSW:7[pp.279–320]
    Documentation: Facebook API (https://developers.facebook.com/)

Week Eleven

  • Network clustering.
    Readings: Papers [27] and [31] — Chapters: NBS:9 and WDM:7.5
  • hands-on session: mining Facebook.
    Readings: Papers [10] — Chapters: MtSW:2[pp.45–86]

Week Twelve

  • Dynamics of information and epidemics spreading.
    Readings: Papers [26] — Chapters: NSB:10.1–10.3[pp.11–29]
  • hands-on session:tutorial on Gephi.
    Readings: Papers [3] and [20] — Chapters: NSB:10.4–10.7[pp.30–58]
    Documentation: Gephi Wiki https://wiki.gephi.org/index.php/Main_Page

Week Thirteen

  • Network visualization algorithms.
    Readings: Papers [1] and [28] — Chapters: PCI:12[pp.300–302(MDS)]
  • hands-on session: tutorial on Gephi.
    Readings: Papers [25] and [8]


Part 5—Intelligent Systems


 Collective Intelligence

I, robot (2004) — © Twentieth Century Fox Film Corporation


Week Fourteen

  • Intelligent systems applications: recommender systems
  • Intelligent systems applications: collaborative filtering

Week Fifteen

  • Project presentations

Week Sixteen: Finals Week

  • Final project poster presentations (to be confirmed)

Reading list


[1]
S. Aral and D. Walker. Identifying influential and susceptible members of social networks. Science, 337(6092):337–341, 2012.

[2] D. M. Blei. Probabilistic topic models. Communications of the ACM, 55(4):77–84, 2012.

[3] R. M. Bond, C. J. Fariss, J. J. Jones, A. D. Kramer, C. Marlow, J. E. Settle, and J. H. Fowler. A 61-million-person experiment in social influence and political mobilization. Nature, 489(7415):295–298, 2012.

[4] S. P. Borgatti, A. Mehra, D. J. Brass, and G. Labianca. Network analysis in the social sciences. Science, 323(5916):892–895, 2009.

[5] D. Centola. The spread of behavior in an online social network experiment. Science, 329(5996):1194–1197, 2010.

[6] D. Centola. An experimental study of homophily in the adoption of health behavior. Science, 334(6060):1269–1272, 2011.

[7] A. Cho. Ourselves and our interactions: the ultimate physics problem? Science, 325(5939):406, 2009.

[8] D. J. Crandall, L. Backstrom, D. Cosley, S. Suri, D. Huttenlocher, and J. Kleinberg. Inferring social ties from geographic coincidences. Proceedings of the National Academy of Sciences, 107(52):22436–22441, 2010.

[9] V. Dhar. Data science and prediction. Communications of the ACM, 56(12):64–73, 2013.

[10] P. S. Dodds, R. Muhamad, and D. J. Watts. An experimental study of search in global social networks. Science, 301(5634):827–829, 2003.

[11] P. Domingos. A few useful things to know about machine learning. Communications of the ACM, 55(10):78–87, 2012.

[12] W. Fan and M. D. Gordon. The power of social media analytics. Communications of the ACM, 57(6):74–81, 2014.

[13] H. Garcia-Molina, G. Koutrika, and A. Parameswaran. Information seeking: convergence of search, recommendations, and advertising. Communications of the ACM, 54(11):121–130, 2011.

[14] M. T. Gastner and M. E. Newman. Diffusion-based method for producing density-equalizing maps. Proceedings of the National Academy of Sciences of the United States of America, 101(20):7499–7504, 2004.

[15] S. A. Golder and M. W. Macy. Diurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures. Science, 333(6051):1878–1881, 2011.

[16] R. F. i Cancho and R. V. Solé. The small world of human language. Proceedings of the Royal Society of London. Series B: Biological Sciences, 268(1482):2261–2265, 2001.

[17] N. Jones. Computer science: The learning machines. Nature, 505(7482):146, 2014.

[18] Y. Koren. Collaborative filtering with temporal dynamics. Communications of the ACM, 53(4):89–97, 2010.

[19] M. Kosinski, D. Stillwell, and T. Graepel. Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences, 110(15):5802–5805, 2013.

[20] A. D. Kramer, J. E. Guillory, and J. T. Hancock. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, page 201320040, 2014.

[21] D. Lazer, R. Kennedy, G. King, and A. Vespignani. Big data. the parable of google flu: traps in big data analysis. Science, 343(6176):1203, 2014.

[22] D. Lazer, A. S. Pentland, L. Adamic, S. Aral, A. L. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, et al. Life in the network: the coming age of computational social science. Science, 323(5915):721, 2009.

[23] D. D. Lee and H. S. Seung. Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755):788–791, 1999.

[24] D. Liben-Nowell and J. Kleinberg. Tracing information flow on a global scale using internet chain-letter dataProceedings of the National Academy of Sciences, 105(12):4633–4638, 2008.

[25] D. Liben-Nowell, J. Novak, R. Kumar, P. Raghavan, and A. Tomkins. Geographic routing in social networksProceedings of the National Academy of Sciences of the United States of America, 102(33):11623–11628, 2005.

[26] P. T. Metaxas and E. Mustafaraj. Social media and the elections. Science, 338(6106):472–473, 2012.

[27] P. J. Mucha, T. Richardson, K. Macon, M. A. Porter, and J.-P. Onnela. Community structure in time-dependent, multiscale, and multiplex networks. Science, 328(5980):876–878, 2010.

[28] L. Muchnik, S. Aral, and S. J. Taylor. Social influence bias: A randomized experiment. Science, 341(6146):647–651, 2013.

[29] R. Nuzzo. Scientific method: statistical errors. Nature, 506(7487):150–152, 2014.

[30] A. Rodriguez and A. Laio. Clustering by fast search and find of density peaks. Science, 344(6191):1492–1496, 2014.

[31] M. Rosvall and C. T. Bergstrom. Maps of random walks on complex networks reveal community structureProceedings of the National Academy of Sciences, 105(4):1118–1123, 2008.

[32] M. J. Salganik, P. S. Dodds, and D. J. Watts. Experimental study of inequality and unpredictability in an artificial cultural market. Science, 311(5762):854–856, 2006.

[33] J. B. Schafer, D. Frankowski, J. Herlocker, and S. Sen. Collaborative filtering recommender systems. In The adaptive web, pages 291–324. Springer, 2007.

[34] M. Schich, C. Song, Y.-Y. Ahn, A. Mirsky, M. Martino, A.-L. Barabási, and D. Helbing. A network framework of cultural history. Science, 345(6196):558–562, 2014.

[35] C. Staff. Recommendation algorithms, online privacy, and more. Communications of the ACM, 52(5):10–11, 2009.

[36] G. Szabo and B. A. Huberman. Predicting the popularity of online content. Communications of the ACM, 53(8):80–88, 2010.

[37] A. Vespignani. Modelling dynamical processes in complex socio-technical systems. Nature Physics, 8(1):32–39, 2012.

[38] A. Vespignani. Predicting the behavior of techno-social systems. Science, 325(5939):425, 2009.

Visit REGULARITY AI for Consultancy & Expert Witness Services