NAME

Word::Segmenter::Chinese::Lite - Split Chinese into words

SYNOPSIS

  use Word::Segmenter::Chinese::Lite qw(wscl_seg wscl_set_mode);

  my @result = wscl_seg("中华人民共和国成立了oyeah");
  foreach (@result)
  {
    print $_, "\n";
  }
  # got:
  # 中华人民共和国
  # 成立
  # 了
  # oyeah

  wscl_set_mode("obigram");
  my @result = wscl_seg("中华人民共和国成立了");
  foreach (@result)
  {
    print $_, "\n";
  }
  # got:
  # 中华
  # 华人
  # 人民
  # 民共
  # 共和
  # 和国
  # 国成
  # 成立
  # 立了
  # 了

  wscl_set_mode("unigram");
  my @result = wscl_seg("中华人民共和国");
  foreach (@result)
  {
    print $_, "\n";
  }
  # got:
  # 中
  # 华
  # 人
  # 民
  # 共
  # 和
  # 国

METHODS

wscl_set_mode($mode)

Optional.

You can choose modes below.

"dict" : Default. 词典分词，本模块自带词典。

"unigram" : 一元分词。

"obigram" : Overlapping Bigram. 交叉二元分词。

wscl_seg($chinese_article, $max_word_length)

Main method.

Input a chinese article which want to de splited.

Output a list.

$chinese_article -- must be utf8 encoding

$max_word_length -- Optional

EXPORT

no method will be exported by default.

AUTHOR

Chen Gang, <yikuyiku.com@gmail.com>

COPYRIGHT AND LICENSE

Copyright (C) 2014 by Chen Gang

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.16.2 or, at your option, any later version of Perl 5 you may have available.