From 1c72b20a760bcd5cd10929efd097f981876cc933 Mon Sep 17 00:00:00 2001 From: Anton Golubev Date: Sun, 23 Jun 2024 18:37:31 +0300 Subject: [PATCH] Added RuSentNE-2023 evaluation (#638) * Update sentiment-analysis.md + RuSentNE-2023 evaluation * Update sentiment-analysis.md updated RuSentNE-2023 * Update sentiment-analysis.md + RuSentNE-2023 --- russian/sentiment-analysis.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/russian/sentiment-analysis.md b/russian/sentiment-analysis.md index 7418c7d3..5c3f09d1 100644 --- a/russian/sentiment-analysis.md +++ b/russian/sentiment-analysis.md @@ -22,3 +22,19 @@ The public leaderboard is available at [github repository](https://github.com/ni | ... Meanwhile Moscow has repeatedly emphasized that its activity in the Baltic Sea is a response precisely to actions of **NATO** and the escalation of the hostile approach to **Russia** near its eastern borders ... | (NATO->Russia, neg), (Russia->NATO, neg) | +## RuSentNE-2023 + +The dataset for RuSentNE-2023 evaluation is based on the Russian news corpus RuSentNE having rich sentiment-related annotation. The corpus +is annotated with named entities and sentiments towards these entities, along with related effects and emotional states. The dataset contains over 11000 sentences from 400+ large texts. + +**Entity-Oriented Sentiment Analysis task:** Given a subset of sentences, in which every sentence includes one or several named entities. For each sentence all of the named entities should be classified into one of three sentiment classes: positive, negative or neutral within the context of a single sentence. + +Task paper: https://arxiv.org/pdf/2305.17679.pdf + +The public leaderboard is available at [github repository](https://github.com/dialogue-evaluation/RuSentNE-evaluation) + +| Example | +|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| +| Notorious figure in the country - Berlusconi has been repeatedly accused of financial fraud +| (Berlusconi-> neg) +