annif.analyzer.voikko.VoikkoAnalyzer._normalize_word() - Code Metrics - Inspection of "Merge pull request #527 from NatLibFi/issue374-spa..." - NatLibFi/Annif - Measure and Improve Code Quality continuously with Scrutinizer

Completed

Push — master ( cf5fd0...1b4762 )

by Osma

created 2022-01-24 08:05 UTC

VoikkoAnalyzer._normalize_word() A

↳ Parent: annif.analyzer.voikko

Complexity

Conditions

Size

Total Lines	8
Code Lines	8

Duplication

Lines	8
Ratio	100 %

Importance

Changes

Metric	Value
cc	4
eloc	8
nop	2
dl	8
loc	8
rs	10
c	0
b	0
f	0

"""Voikko analyzer for Annif, based on libvoikko library."""

import functools
import voikko.libvoikko
from . import analyzer


class VoikkoAnalyzer(analyzer.Analyzer):

    name = "voikko"

    def __init__(self, param, **kwargs):
        self.param = param
        self.voikko = None
        super().__init__(**kwargs)

    def __getstate__(self):
        """Return the state of the object for pickling purposes. The Voikko
        instance is set to None because as a ctypes object it cannot be
        pickled."""

        return {'param': self.param, 'voikko': None}

    @functools.lru_cache(maxsize=500000)
    def _normalize_word(self, word):
        if self.voikko is None:
            self.voikko = voikko.libvoikko.Voikko(self.param)
        result = self.voikko.analyze(word)
        if len(result) > 0 and 'BASEFORM' in result[0]:
            return result[0]['BASEFORM']
        return word


1		"""Voikko analyzer for Annif, based on libvoikko library."""
2
3		import functools
4		import voikko.libvoikko
5		from . import analyzer
6
7
8	View Code Duplication	class VoikkoAnalyzer(analyzer.Analyzer):
		0 ignored issues – show Duplication introduced 2022-01-18 08:57 UTC by Report Bug Copy Issue Report This code seems to be duplicated in your project. Loading history...
9		name = "voikko"
10
11		def __init__(self, param, **kwargs):
12		self.param = param
13		self.voikko = None
14		super().__init__(**kwargs)
15
16		def __getstate__(self):
17		"""Return the state of the object for pickling purposes. The Voikko
18		instance is set to None because as a ctypes object it cannot be
19		pickled."""
20
21		return {'param': self.param, 'voikko': None}
22
23		@functools.lru_cache(maxsize=500000)
24		def _normalize_word(self, word):
25		if self.voikko is None:
26		self.voikko = voikko.libvoikko.Voikko(self.param)
27		result = self.voikko.analyze(word)
28		if len(result) > 0 and 'BASEFORM' in result[0]:
29		return result[0]['BASEFORM']
30		return word
31

NatLibFi / Annif

Push — master ( cf5fd0...1b4762 )

VoikkoAnalyzer._normalize_word() A

Complexity

Size

Duplication

Importance

Duplication Side-by-Side

Filter issues like