harvester package

Subpackages

• harvester.autoparser package
  • Submodules
    • conf_reader
    • generator
    • path_patterns
    • utils
    • vectors
• harvester.filters package
  • Submodules
    • Aleph filter
    • Duplication filter
• harvester.scrappers package
  • Submodules
    • ben.cz scrapper
    • cpress.cz scrapper
    • grada.cz scrapper
    • zonerpress_cz scrapper
    • harvester.scrappers.utils module

Submodules

• edeposit_autoparser.py
  • Configuration file
  • How it works
  • API
• settings
  • Attributes
• structures

Module contents

harvester.get_all_publications(return_namedtuples=True)

Get list publications from all available source.

Parameters:return_namedtuples (bool, default True) – Convert Publication structures to namedtuples (used in AMQP communication). Returns:list – List of Publication structures converted to namedtuple.

harvester.self_test()

Perform selftest.

Returns:None – None if everything is ok. Raises:UserWarning – If one of the tests fails.