Python for secret agents Volume II : gather, analyze, and decode data to reveal hidden facts using Python, the perfect tool for all aspiring secret agents Volume II :
Gather, analyze, and decode data to reveal hidden facts using Python, the perfect tool for all aspiring secret agents About This Book Discover the essential features of Python programming: statements, variables, expressions, and many of the built-in data types Use Python's standard library to d...
| Otros Autores: | |
|---|---|
| Formato: | Libro electrónico |
| Idioma: | Inglés |
| Publicado: |
Birmingham :
Packt Publishing
2015.
|
| Edición: | Second edition |
| Colección: | Community experience distilled.
|
| Materias: | |
| Ver en Biblioteca Universitat Ramon Llull: | https://discovery.url.edu/permalink/34CSUC_URL/1im36ta/alma991009629692606719 |
Tabla de Contenidos:
- Cover ; Copyright; Credits; About the Author; About the Reviewer; www.PacktPub.com; Table of Contents; Preface; Chapter 1: New Missions - New Tools ; Background briefing on tools; Doing a Python upgrade; Preliminary mission to upgrade pip; Background briefing: review of the Python language; Using variables to save results; Using the sequence collections: strings; Using other common sequences: tuples and lists; Using the dictionary mapping; Comparing data and using the logic operators; Using some simple statements; Using compound statements for conditions: if
- Using compound statements for repetition: for and whileDefining functions; Creating script files; Mission One - upgrade Beautiful Soup; Getting an HTML page; Navigating the HTML structure; Doing other upgrades; Mission to expand our toolkit; Scraping data from PDF files; Sidebar on the ply package; Building our own gadgets; Getting the Arduino IDE; Getting a Python serial interface; Summary; Chapter 2: Tracks, Trails, and Logs ; Background briefing - web servers and logs; Understanding the variety of formats; Getting a web server log; Writing a regular expression for parsing
- Introducing some regular expression rules and patternsFinding a pattern in a file; Using regular expression suffix operators; Capturing characters by name; Looking at the CLF; Reading and understanding the raw data; Reading a gzip compressed file; Reading remote files; Studying a log in more detail; What are they downloading?; Trails of activity; Who is this person?; Using Python to run other programs; Processing whois queries; Breaking a request into stanzas and lines; Alternate stanza-finding algorithm; Making bulk requests; Getting logs from a server with ftplib
- Building a more complete solutionSummary; Chapter 3: Following the Social Network ; Background briefing - images and social media; Accessing web services with urllib or http.client; Who's doing the talking?; Starting with someone we know; Finding our followers; What do they seem to be talking about?; What are they posting?; Deep Under Cover - NLTK and language analysis; Summary; Chapter 4: Dredging up History ; Background briefing-Portable Document Format; Extracting PDF content; Using generator expressions; Writing generator functions; Filtering bad data; Writing a context manager
- Writing a PDF parser resource managerExtending the resource manager; Getting text data from a document; Displaying blocks of text; Understanding tables and complex layouts; Writing a content filter; Filtering the page iterator; Exposing the grid; Making some text block recognition tweaks; Emitting CSV output; Summary; Chapter 5: Data Collection Gadgets ; Background briefing: Arduino basics; Organizing a shopping list; Getting it right the first time; Starting with the digital output pins; Designing an external LED; Assembling a working prototype; Mastering the Arduino programming language
- Using the arithmetic and comparison operators
