Commit Graph

1239 Commits

Author SHA1 Message Date
Pavel Odintsov 09a43cef4e Added per subnet counters for IPv6 and they work 2020-11-15 15:45:56 +00:00
Pavel Odintsov fd8930b27e Includes cleanup for main file 2020-11-15 15:19:31 +00:00
Pavel Odintsov 58cab7c762
IPv6 tracking support (#881) 2020-11-15 15:12:52 +00:00
Pavel Odintsov cd3f002a90
Added logic to show total IPv6 counters in fastnetmon_client (#880) 2020-11-15 13:49:02 +00:00
Pavel Odintsov c6a1c98582 Removed obsoleted values from configuration 2020-11-15 12:47:03 +00:00
Pavel Odintsov 86ee4a1f9f
Added IPv6 flag for fastnetmon_client (#879) 2020-11-15 12:39:55 +00:00
Pavel Odintsov 203da029ea
Unified packet processing path (#878) 2020-11-15 01:41:18 +00:00
Pavel Odintsov 50bb596252 Moved traffic sample collection logic into separate branch 2020-11-15 00:04:02 +00:00
Pavel Odintsov e9b0b273d6
We have to revert process internal as external logic because it make migration to new counters logic impossible (#877) 2020-11-14 23:45:42 +00:00
Pavel Odintsov 6f62a77b16
Moved logic to unified functions (#876) 2020-11-14 23:19:13 +00:00
Pavel Odintsov e3344cb726
Added logic to maintain metrics for structures with arbitrary key structure (#875) 2020-11-14 22:35:32 +00:00
Pavel Odintsov 2c20dab66c
Added logic to track total number of IPv6 packets (#874) 2020-11-14 21:45:24 +00:00
Pavel Odintsov f2dc853247
Added logic to lookup IPv6 prefix for incoming packet (#873) 2020-11-14 20:41:15 +00:00
Pavel Odintsov cc63c04334 Removed obsoleted PoC IPv6 logic 2020-11-14 19:50:03 +00:00
Pavel Odintsov dac452abbf Fix for PF_RING deprecation and switched to http for boots download on Debian 8 2020-10-31 17:35:41 +00:00
Pavel Odintsov 6dc575095b Deprecated PF_RING filters compeltely 2020-10-31 17:24:23 +00:00
Pavel Odintsov d021179c73
Another stage of big refactoring (#871) 2020-10-31 15:57:13 +00:00
Pavel Odintsov d51ad89ac7
Second step of business logic refactoring (#870) 2020-10-31 15:22:41 +00:00
Pavel Odintsov 3ead151c1d
Introduced fastnetmon_logic which will keep keep all business logic functions (#869) 2020-10-31 14:22:22 +00:00
Pavel Odintsov 91b035c8a2 We need to use custom LD_LIBRARY path for Boost build 2020-10-31 00:28:17 +00:00
Pavel Odintsov 5750bc3a08 We need to specify LD_LIBRARY_PATH for b2 because we use very fresh compiler for it 2020-10-31 00:17:36 +00:00
Pavel Odintsov 935fc80dd9 Added OpenSSL and Capnp into libraries bundle. Reduced number of build threads for Boost 2020-10-31 00:09:45 +00:00
Pavel Odintsov 75638fcb30 Switched to current version of Boost Build tool 2020-10-30 23:32:16 +00:00
Pavel Odintsov 316ade7c71 Unified Boost Build to same version; Upgrade Boost to 1.74 2020-10-30 22:50:01 +00:00
Pavel Odintsov 045e3a29fd Added more details about deetected libraries 2020-10-30 00:34:53 +00:00
Pavel Odintsov c53fd707bf Documented all flags for build script 2020-10-30 00:22:10 +00:00
Pavel Odintsov 98dcb8ef68 Added lib64 folder for mongo-c driver on CentOS family 2020-10-29 13:13:08 +00:00
Pavel Odintsov c6b4a32930 Switched path for grpc in library build logic 2020-10-29 11:06:25 +00:00
Pavel Odintsov b9e1163364 Attempt to upgrade cmake to address target pattern contains no '%'. Stop. 2020-10-29 10:54:29 +00:00
Pavel Odintsov 30b5600160 Upgrade for gRPC and chanegd path for OpenSSL to use custom build 2020-10-29 10:33:28 +00:00
Pavel Odintsov 36b029def4 Split FNM build and dependencies build into different steps for easier rerun 2020-10-28 18:50:30 +00:00
Pavel Odintsov 9c1475c1ec Made library bundle builder more strict. Mongoc is mandatory dependency since now 2020-10-25 18:28:02 +00:00
Pavel Odintsov ce57e575e7 We need to pass LD_LIBRARIES path to make after cmake call 2020-10-25 14:23:42 +00:00
Pavel Odintsov 2e7ed00ed2 Few more fixes to handle compile version bump 2020-10-25 12:39:37 +00:00
Pavel Odintsov 781daa67ea Switched compiler to GCC 9.3 to address compilation issues on Ubuntu 20.04 2020-10-25 12:10:56 +00:00
Pavel Odintsov 80a474882f Removed last tracking logic from build code 2020-10-25 10:27:42 +00:00
Pavel Odintsov b11d81d58c Did serious cleanup for fastnetmon_build.pl script 2020-10-25 10:20:01 +00:00
Pavel Odintsov 5ff48c00ed We do not need logic which installs from binary package 2020-10-24 21:27:20 +01:00
Pavel Odintsov 0144a0eba4 Switched to use custom compiler on all platforms. I see no reasons to maintain different configurations for different platforms 2020-10-24 21:19:20 +01:00
Pavel Odintsov 3ffdbabd72 We need to use LD_LIBRARY_PATH for cmake on platoforms with custom compiler 2020-10-24 21:09:57 +01:00
Pavel Odintsov d66eda66a7 Fixed bug. We added linking with capnp before it was discovered 2020-10-24 21:03:40 +01:00
Pavel Odintsov 27864d9b8c Fixed capnp compilation logic for FNM 2020-10-24 19:02:55 +01:00
Pavel Odintsov 3c2169a058 Upgraded Mongoc and added script to install cmake based libraries automatically 2020-10-24 18:31:01 +01:00
Pavel Odintsov 7aa66ff73a Made gobgp, api and boost build options default. Switched to C++ 14 2020-10-24 00:21:53 +01:00
Pavel Odintsov b00ec619ab
Added linking with custom OpenSSL (#866) 2020-10-24 00:04:50 +01:00
Pavel Odintsov b3e63df7eb
Added support for sending capnp encoded messages (#865) 2020-10-23 23:22:55 +01:00
Pavel Odintsov c8941ab42a Fixed bug with capnp compilation on CentOS 6 2020-10-23 21:50:03 +01:00
Pavel Odintsov c5c24e8fc0 Updated capnp to 0.8.0 to address bug: https://github.com/capnproto/capnproto/issues/743 2020-10-20 02:11:14 +01:00
Pavel Odintsov fe31422709 Allowed gcc build for non CentOS 6 platforms 2020-10-20 01:56:25 +01:00
Pavel Odintsov 14f551a18f Moved compiler configuration to argument, switches CentOS 7 and Ubutnu 14.04 to custom compiler 2020-10-20 00:18:50 +01:00
Pavel Odintsov 778aa47f82 Force C++ 11 for Poco library 2020-10-19 23:58:54 +01:00
Pavel Odintsov 7bb6b45e47
Adding support for capnp, poco and OpenSSL for new logic. (#863) 2020-10-19 23:02:16 +01:00
Pavel Odintsov 23f3613e43 Enabled build mode by default. Disabled mirror use by default 2020-10-19 21:44:42 +01:00
Max Dobladez 1623dcc0a3
fix routeros api support (#862)
* Add files via upload

support api-ssl for post MikroTik 6.45.1

* Update README.md

* Update README.md
2020-10-12 18:59:35 +01:00
Pavel Odintsov c87cd905c6 Fixed mask conversion logic for 0.0.0.0/0 networks. Fixes #123 2020-09-27 13:01:48 +01:00
Pavel Odintsov da30452fc1
Removed Snabb Switch support. Closes #858 (#859) 2020-09-27 12:22:50 +01:00
Pavel Odintsov eb887c80dd Switched back to release build 2020-09-26 20:47:04 +01:00
Pavel Odintsov 7abcdbf8ee Implemented logic to properly track internal traffic for incoming and outgoing directions 2020-09-26 20:40:28 +01:00
Pavel Odintsov 23efd99d27 Added C++ debug flags 2020-09-26 19:29:24 +01:00
Pavel Odintsov 38886ec4fe Added option to enable build with debug symbols 2020-09-26 19:26:53 +01:00
Pavel Odintsov bf4213fa4f
Added option to process intrenal traffic as external for attack detection purposes. Closes #856 (#857) 2020-09-25 18:35:35 +01:00
Pavel Odintsov 5a1db9e4db
Switched to using binaries for 1.1.7 version from installer 2020-09-12 09:33:16 +01:00
Pavel Odintsov 6859702b00 Moved stable version release into variable 2020-08-29 14:12:57 +01:00
Pavel Odintsov 13023204dd Added option to install FastNetMon packages directly from CI 2020-08-29 14:02:49 +01:00
Pavel Odintsov c3b04103cc Added missing include for std::thread for Netflow code 2020-08-29 13:51:39 +01:00
Pavel Odintsov db79cfb259
Deprecated LUA support. Closes #852 (#853) 2020-08-29 13:46:09 +01:00
Pavel Odintsov bc095bc1c3
Completely reworked Netflow and IPFIX support logic (#851) 2020-08-29 00:59:36 +01:00
Pavel Odintsov 9bb0cd085b
Implemented option to configure delay between traffic recalculations: speed_calculation_delay (#850) 2020-08-28 22:52:07 +01:00
Pavel Odintsov c0286711cc
Implemented sanity checks for sample / records lengths received from the wire in libsflow logic. Closes: #848 (#849) 2020-08-25 19:55:40 +01:00
Pavel Odintsov 4e7f714d1e Disabled memory pre-allocation in libsflow code to address security issue. Closes: #847 2020-08-24 21:57:17 +01:00
Pavel Odintsov ad5533bee2 Extracted endianless conversion functions to separate file 2020-08-23 14:29:12 +01:00
Pavel Odintsov 8e9e782b65 Fixed indentation issue 2020-08-23 13:28:30 +01:00
Jasper Lievisse Adriaanse 40689e8b68
Lacking SIOCGIFINDEX, fall back to if_nametoindex(3) (#832) 2020-08-19 19:37:12 +01:00
Pavel Odintsov 47720f899f Changed URL to official site 2020-08-02 16:15:30 +01:00
Pavel Odintsov 37c1404f4c Switched sflow plugin to our own libsflow parser. Closes #843 2020-08-02 15:36:15 +01:00
Pavel Odintsov 7b22357404
Added new sFlow parser which will replace exiting one. Closes #841 (#842) 2020-08-02 14:27:14 +01:00
Pavel Odintsov b9068dc1d7
Require C++ 11 support in compiler. Dropped CI target which builds code on standard gcc compilers in CentOS 6. Closes #839 (#840) 2020-08-02 13:24:30 +01:00
Pavel Odintsov add9b4a02b
Introduced new parser for traffic. Closes #837 (#838) 2020-08-02 13:12:42 +01:00
Pavel Odintsov c55eab60dc
Moved simple_packet into separate file to break include cycle. Closes #835 (#836) 2020-08-02 12:28:49 +01:00
Pavel Odintsov 5285bc36ef
Added new structures for network packets processing #833 (#834) 2020-08-02 12:04:37 +01:00
Pavel Odintsov 8d0a8825b2
Bump version for new builds 2020-07-30 12:03:05 +01:00
Jasper Lievisse Adriaanse c3303f46de
include sys/socket.h before net/if_arp.h (#825)
On least OpenBSD this is required as otherwise the build fails with:
/usr/include/net/if_arp.h:79:18: error: field has incomplete type 'struct sockaddr'
2020-07-29 21:25:29 +01:00
Abdullah e439e278f0
typo in doc (#824)
Just found it while reading doc so fixed it...
2020-07-29 21:22:21 +01:00
Pavel Odintsov 20150977a5
Made option to read list of networks from OpenVZ configurable and optional (#831) 2020-07-29 21:20:37 +01:00
Pavel Odintsov 9ba053222d Switched to using only latin symbols for all commands output to simplify error tracking 2020-06-28 22:14:38 +01:00
Pavel Odintsov c8d8369ce9 Disabled mongoc build for CentOS 7 too, issue #822 2020-06-27 19:49:42 +01:00
Pavel Odintsov af95cedac7 Fixed stripping bug 2020-06-27 17:39:12 +01:00
Pavel Odintsov eb20ddb57e Disabled Mongo C compilation for Debian 9 to addrss compilation issue caused by fresh OpenSSL. Issue # 822 2020-06-27 17:10:14 +01:00
Pavel Odintsov d8cf80abf4 Added stripe command to strip useless debug information from our dependency libraries 2020-06-27 15:57:44 +01:00
Pavel Odintsov f25bf202e6 Added correct command about error stream redirection 2020-06-27 15:49:24 +01:00
Pavel Odintsov 06efa910b5 Added conf option to explicitly avoid any questions regarding configuration file during installation 2020-06-27 15:33:22 +01:00
Pavel Odintsov 39aeb8641f Fixed error steram redirection 2020-06-27 15:09:07 +01:00
Pavel Odintsov 1c5f37fd25 Increased compression level for packages to reduce their size and improve download speed. 2020-06-27 15:01:13 +01:00
Pavel Odintsov 20acc02a6a Switched from apt to apt-get because apt is not recommended in scripts and triggers warning 2020-06-27 14:54:45 +01:00
Pavel Odintsov 4e17ce3c5c Added DEBIAN_FRONTEND=noninteractive flag to avoid installation failures 2020-06-27 14:42:02 +01:00
Pavel Odintsov f1d0f2e04c Improved logic for install, made it less verbose and added loging for exact error messages 2020-06-23 18:02:48 +01:00
Pavel Odintsov 36fc121f85 Split fastnetmon_install.pl into two scripts and moved all source compilation logic into fastnetmon_build.pl 2020-06-23 00:15:44 +01:00
Pavel Odintsov 81fc921d50 Disabled GA tracking for customers explicitly requested for privacy 2020-06-20 22:46:01 +01:00
Pavel Odintsov 9a90224fcf Added Google Analytics to track number of failed installation 2020-06-20 15:15:16 +01:00
Pavel Odintsov 50b0fbd265 Added standard info banner and reduced installer verbosity 2020-06-13 21:09:40 +01:00