Python Basics
Python Basics

Pathway and Gene Set Overdispersion Analysis

... Grace
schedule4 min read
Python Basics

Python processing bam/sam file tool pysam

... Lucas
schedule2 min read
Python Basics

Use Seurat for RNA Velocity

... Jackson
schedule2 min read
Python Basics

Debian Docker installation

Uninstall the old version of Dockersudo apt-get remove docker docker-engine docker.io containerd runcInstall Docker Engine-Community1. Need to set up Docker warehouse, install and update Docker from the warehouse#Update the apt package index. sudo apt-get update #Install the apt dependency package, which is used to obtain the warehouse through HTTPS. sudo apt-get install \ apt-transport-https \ ca-certificates \ curl \ gnupg2 \ software-properties-common #Add Docker's official GPG key: curl -fsS

... Aaron
schedule2 min read
Advanced Python
trending_up Advanced Python

Analysis of the current situation of the epidemic

... Steven
favorite 1530
trending_up Advanced Python

Crawling historical hot searches, how many hot searches has Wuhan been on?

... Luis
favorite 1548
trending_up Advanced Python

Crawling Doctor Lilac to generate a heat map of the epidemic

... Miguel
favorite 1195
trending_up Advanced Python

Python script GUI interface generation tool

... Matthew
favorite 926
trending_up Advanced Python

Crawling Weibo hot search comments to generate word cloud

... Christopher
favorite 1774
trending_up Advanced Python

Through data, understand the current situation of recruitment and reap your offer

... Sophia
favorite 1084
Python Web Development
Python Web Development

Python爬虫框架资源集合，包括Scrapy、PySpider等

scrapy - 最出名的网络爬虫，一个快速,高层次的屏幕抓取和web抓取框架，用于抓取web站点并从页面中提取结构化的数据。Scrapy用途广泛，可以用于数据挖掘、监测和自动化测试。官方主页,Scrapy 轻松定制网络爬虫 - 教程，Scrapy 中文指南 。BeautifulSoup - Beautifu Soup不完全是一套爬虫工具，需要配合urllib使用，而是一套HTML/XML数据分析，清洗和获取工具。python-goose - Python-Goose用Python重写，依赖了Beautiful Soup。给定一个文章的URL, 获取文章的标题和内容很方便。Python-goose的目标是给定任意资讯文章或者任意文章类的网页，不仅提取出文章的主体，同时提取出所有元信息以及图片等信息，支持中文网页。newspaper - 是用于进行新闻提取、文章提取和内容爬取的开源框架。Portia - 是一个让你可视化爬取网站的工具，不需要任何编程知识，你可以通过注释所需网页来提取数据。grab - 是一个网页爬虫抓取框架，grab为异步处理数据提供了多种有效的方法demiurge -

... Madison
schedule 1 min read
Python Web Development

Do you really understand web crawlers?

Behind websites such as Google and Yahoo, there is a powerful web collection program that can crawl all the web pages around the world and store them for search purposes. This program is called "Crawler", and some people simply call it "Crawler". Spider, because this is like a spider crawling around on the web, crawling around the web and going home. So what exactly is a web crawler? Cheng Zijun will explore the "web crawler" with everyone, hoping to help everyone.What is a web crawler?Wikipedi

... Brandon
schedule 6 min read
Python Web Development

Summary of anti-crawler mechanism and cracking methods

What are reptiles and anti-reptiles?Crawler : A way to obtain website information in batches using any technical means.Anti-crawler : Use any technical means to prevent others from obtaining information on your own website in batches. Common anti-crawler mechanismRecognize crawlers through UA Some crawlers have special UAs, which are different from those of normal browsers. The crawler request can be blocked directly by identifying the characteristic UA.Set the IP access frequency. If it exceeds

... Hailey
schedule 4 min read
Machine Learning
Machine Learning

Python crawler breaks through the limitations and crawls VIP video resources! (source code attached)

It mainly introduces the example code of the python crawler project. The example code introduced in the article is very detailed. It has a certain reference learning value for everyone's study or work. Friends who need it can refer toI don’t say much and attach the source code directly.As long as you learn crawler technology, you can basically do whatever resources you want to crawl. Of course, Python is not only crawler technology, but also web development, big data, artificial intelligence, et

Read Article
Machine Learning

I have roughly studied Python in university, how to learn Python further after entering the workplace

People in the workplace learning Python language should base their own job tasks to formulate a learning route. This will not only have a better application scenario, but also increase the added value of the job to a certain extent, thereby promoting their own job upgrades. In the specific learning process, you can learn Python in the following three stages:First: the basic grammar stage. Learning Python must start from the basic grammar. Generally speaking, the basic grammar of Python is relati

Read Article
Machine Learning

Python data analysis learning route

Overviewdata analysis:Data analysis refers to the process of analyzing a large amount of collected data with appropriate use of statistical analysis methods, extracting useful information and forming conclusions, and the process of detailed research and generalization of the data. Analyze the data and get the resultLearning routeBasic part:Mathematical knowledgeBasic knowledge of PythonPython data analysis package usageAdvanced part:Web crawlerMachine learning and deep learningBig Data1. Basic p

Read Article
Machine Learning

Can a zero-based learner be able to get a job if he spends a year to learn Python?

For those who do not have any programming foundation, it is a good choice to choose to learn Python. On the one hand, the grammatical structure of the Python language itself is easier to grasp, and on the other hand, Python experiments are also easier to do, which will enhance the learning achievement of beginners. , So as to be able to go further. In addition, the Python language is one of the full-scene programming languages. It has a wide range of applications in the fields of Web development

Read Article
Machine Learning

What kind of computer do I need to learn Python?

However, learning Python often requires a relatively clear learning direction. Different learning directions still have some specific requirements in the configuration of the computer. At present, the main learning directions of Python include web development, big data development, artificial intelligence development and embedded development, among which big data development and artificial intelligence development still have certain requirements for computer configuration.The development of big

Read Article
Machine Learning

How to learn Python with zero foundation? Is there a roadmap for learning Python?

1. Code step by stepIn the Python learning tutorial, when the corresponding grammar rules are mentioned, there must be corresponding cases. Python novices should type the code step by step. Remember not to copy directly, but to write silently, and then compare to find errors in time, and Corrected.2. Stage case practiceFor regular Python learning tutorials, staged homework assessments, also known as cases, will be arranged. A staged case is more comprehensive, and it can objectively investigate

Read Article
Machine Learning

Python crawler-crawling the source code of Doutu Bar

Are you still searching around the Internet for no emoji? Today, let’s use python to get the emoticons we want.Project source codefrom pyquery import PyQuery as pq import requests from redis import StrictRedis o=0 headers={ 'user-agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.0' } def xpan(canshu): try: url ='https://www.doutula.com/photo/list/?page=' + str(canshu) sp = requests.get(url, headers=headers).text

Read Article
9 10 11 12 13 14 15 16 17 18 19 20