Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Poor TP Matchrates when using the EventBasedDetector and Telegram Datasets #2

Open
lnx1-1 opened this issue Apr 13, 2023 · 0 comments

Comments

@lnx1-1
Copy link

lnx1-1 commented Apr 13, 2023

Hello,

I'm trying to recreate the results published in the paper by using the EventBasedDetector with the Telegram Datasets..

Because the Code isn't runnable like that, I changed the loading part of it and preparsed the .pcaps and Message-Traces files to .csv files.
Everything from the logic itself I didn't changed.

However when i try to run it I get these results.

For 180-second interval:
    Matchrate TP: 0.15398632970137208
    Matchrate FP: 0.0030533821874483323
    from 472 Total intervals
For 300-second interval:
    Matchrate TP: 0.16517058456417724
    Matchrate FP: 0.0033411625104745827
    from 418 Total intervals
For 900-second interval:
    Matchrate TP: 0.1922539784404055
    Matchrate FP: 0.004415161263713601
    from 271 Total intervals
For 1800-second interval:
    Matchrate TP: 0.23280624793962684
    Matchrate FP: 0.005708325299575498
    from 172 Total intervals

(The Matchrates are calculated by the average over all Files and Intervals in that given observation timespan)

The TP are very low and dont come even close to the ones published in the paper.

What am I doing wrong here ?


The Modified JupiterNotebook (Python 3.11.3):

The converted Dataset that I used
(converted from the first 100 files in \telegram\normal\adversary_message_traces and \telegram\normal\pcaps)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant