In this post, I would like to share my implementation of several famous first-order optimization methods. I know that these methods have been implemented very well in many packages, but I hope my implementation can help you understand the ideas behind it. Suppose we have \(N\) data examples and the parameters \(\mathbf{w} \in \mathcal{R}^D\). For convenience, I first write a class named optimizer. class optimizer: def __init__(self): pass def set_param(self, parameters): self.

Continue reading

As we all know, insects are a major factor in the world's agricultural economy. Therefore, it is particularly important to prevent and control agricultural insects by using procedures such as dynamic surveys and real-time monitoring systems for insect population management. However, there are many insects in the farmland, and it takes a lot of time to be manually classified by insect experts. Since people without the knowledge of entomology cannot distinguish the types of insects, it is necessary to develop more rapid and effective methods to solve this problem.

Continue reading

I believe that for graduate students, what to do after graduation may not have been decided yet. Is it a good choice to continue to study for a PhD, or is it a wise choice to find a job in the industry? What will doctoral degrees bring to students? Which field of doctoral degrees are more popular? To answer these questions, I found some historical data about doctorates awarded in the United States to display some information behind the data.

Continue reading

Star Wars API (SWAPI) is the world's first quantitative Star Wars data set that can be used for programming. The developers have aggregated multiple types of entity data involved in the Star Wars series of movies. It also provides a Python programming language package, swapi-python, which is built by the author of swapi, Paul Hallett. The six APIs correspond to six types of entities: Films:http://swapi.co/api/films/1 People:http://swapi.co/api/people/1 Starships:http://swapi.co/api/starships/1 Vehicles:http://swapi.co/api/vehicles/1 Species:http://swapi.

Continue reading

During my internship at Birch.ai, we want to test and improve the performance of our machine translation model. To achieve this, we first need to obtain a foreign language data set and its corresponding English data set, and hope that these data sets are translated by humans rather than machine translations. In this article, I would share my experience in scraping The New England Journal of Medicine from scratch using Python.

Continue reading

How to convert Python data frame to Sqlite3 database? It is quite easy in the Jupyter Notebook with sql extension. With this powerful extension, we can excecute SQL query in Jupyter Notebook, which is quite convenient. In this article, I would share my experience in creating a Sqlite3 database to store Spotify songs data in the 3rd Normal Form using Python. It is quite easy, everyone who has some basic Python skills can follow my steps and try to do it.

Continue reading

Malaria is a serious and sometimes fatal disease caused by a parasite that commonly infects a certain type of mosquito which feeds on humans. People who get malaria are typically very sick with high fevers, shaking chills, and flu-like illness. Because malaria causes so much illness and death, the disease is a great drain on many national economies. Since many countries with malaria are already among the poorer nations, the disease maintains a vicious cycle of disease and poverty.

Continue reading

Author's picture

Linlin Li

Data Scientist @ DISH Network | Master’s in Statistical Science @ Duke

Denver, CO