collaborative |

Twitter URL Analysis

Sun, 27 Jan 2019 00:00:00 +0000

Summary

The goal of the GETAR project is to devise interactive, integrated, digital library/archive systems coupled with linked and expert-curated web-page/tweet collections. In this class team project, the URL analysis system we designed takes a Tweet Collection as input and uses Hadoop and Spark to extract short URLs. We expanded them, fetched their web-page with the corresponding long URL, and applied the WayBack CDX Server API to attempt to restore the most likely snapshot. Then, we conducted a systematic URL analysis, for different types of events. We analyzed nine tweet collections in four categories: Nature, Health, Man-made, and Particular Event. Each tweet collection contains the tweet content from 2013-2017 that related to a specific keyword. For each collection, we analyzed several characteristics in URLs, top-k domains of the URLs, URL retrieve rate, and URL retrieve rate boosted by using the WayBack CDX Server API. We provided several visualizations of the results we analyzed from these nine tweet collections. We have refined this project so that it is easy to build on; see section 5 (Developer Manual) in the final report for details.

Global Event and Trend Archieve

Mon, 29 Jan 2018 00:00:00 +0000

About Global Event and Trend Archieve

The GETAR project will devise interactive, integrated, digital library/archive systems coupled with linked and expert-curated webpage/tweet collections, covering key parts of the 1997-2020 timeframe, in collaboration with the Internet Archive (IA) and colleagues from diverse disciplines. Supporting research on urgent global challenge events and initiatives, the project will allow diverse stakeholder communities to interactively collect, organize, browse, visualize, study, analyze, summarize, and explore content and sources related to biodiversity, climate change, crises, disasters, elections, energy policy, environmental policy/planning, geospatial information, green engineering, human rights, inequality, migrations, nuclear power, population growth, resiliency, shootings, sustainability, violence, etc. GETAR will leverage VT research on Web archiving, HCI, digital libraries, information retrieval, machine learning, discovery analytics, and natural language processing. Those interested in participating are invited to contact any of the co-PIs. Read More.

Cloud Based Software Development

Fri, 27 Jan 2017 00:00:00 +0000

Summary

Take Note is a cloud software system that enables a user with an account to create a note in an HTML editor containing multimedia content such as formatted text, coloring and highlighting text, hyperlinks to videos and other resources, and inserted images and photos. The multimedia note shall be viewable and downloadable in the PDF format.

The user will have a contact list, with which the user can add contact with other user using this application. This feature is also used to share notes with other users.

The table of notes is implemented for the user to create, edit, view, share, delete, export, and search the notes they have. Moreover, the user can also upload a .txt file as a note to the server.

All user activities are keep tracked by the activity tracker shown at the bottom of “My Profile Page.”

Integrated JavaEE, MySQL, and open-sourced APIs (NetBeans, GlassFish, tinyMCE) to build the client, web, business tiers, and data source tiers
Experienced the whole life-cycle of cloud software development
Familiarized with various software design patterns
Implemented an interactive user activity tracker in a timeline manner
Coordinated a team of five in the design and implementation of the application