|
...
|
...
|
@@ -15,4 +15,21 @@ File sample: |
|
|
|
```
|
|
|
|
File Pattern: `本地IP|用户IP|当前时间|HTTP请求方式|User-Agent|请求标示|请求参数|HTTP响应码|请求处理时间`
|
|
|
|
|
|
|
|
## File extractor |
|
|
\ No newline at end of file |
|
|
|
## Spark streaming proccessing
|
|
|
|
### Top 100 IP QPS in 1 seconds
|
|
|
|
Given the table for Top QPS in 1 seconds. For example:
|
|
|
|
|
|
|
|
| IP | QPS |
|
|
|
|
|---------|-----|
|
|
|
|
| 1.2.3.4 | 100 |
|
|
|
|
| 1.2.3.5 | 80 |
|
|
|
|
|
|
|
|
### Top QPS IP Access Summary
|
|
|
|
Given the IPs ( in above table) Access summary, For example:
|
|
|
|
|
|
|
|
| IP | method | QPS |
|
|
|
|
|---------|------------------------|-----|
|
|
|
|
| 1.2.3.4 | app.passport.signinAES | 100 |
|
|
|
|
| 1.2.3.4 | app.passport.profile | 80 |
|
|
|
|
| 1.2.3.5 | app.passport.profile | 30 |
|
|
|
|
|
...
|
...
|
|
